-- Logs begin at Mon 2022-04-11 15:42:56 UTC, end at Mon 2022-04-11 17:02:05 UTC. -- Apr 11 16:26:00.259565 dv-cinder-837165-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 11 16:26:00.269475 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 11 16:26:00.271579 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Apr 11 16:26:00 2022] *** Apr 11 16:26:00.271579 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 11 16:26:00.271579 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 11 16:26:00.271579 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: nodename: dv-cinder-837165-2-iscsi Apr 11 16:26:00.271579 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: machine: x86_64 Apr 11 16:26:00.271579 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: clock source: unix Apr 11 16:26:00.271579 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: pcre jit disabled Apr 11 16:26:00.271579 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: detected number of CPU cores: 4 Apr 11 16:26:00.271579 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: current working directory: / Apr 11 16:26:00.271579 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: detected binary path: /usr/bin/uwsgi-core Apr 11 16:26:00.272312 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: your processes number limit is 47680 Apr 11 16:26:00.272312 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: your memory page size is 4096 bytes Apr 11 16:26:00.272312 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: detected max file descriptor number: 2048 Apr 11 16:26:00.272312 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: lock engine: pthread robust mutexes Apr 11 16:26:00.272312 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: thunder lock: enabled Apr 11 16:26:00.272312 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 11 16:26:00.272312 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 11 16:26:00.317669 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: Python main interpreter initialized at 0x55a185cf69c0 Apr 11 16:26:00.317669 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: python threads support enabled Apr 11 16:26:00.317669 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: your server socket listen backlog is limited to 100 connections Apr 11 16:26:00.317669 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: your mercy for graceful operations on workers is 90 seconds Apr 11 16:26:00.318020 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: mapped 403077 bytes (393 KB) for 2 cores Apr 11 16:26:00.318020 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: *** Operational MODE: preforking *** Apr 11 16:26:00.318262 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: *** uWSGI is running in multiple interpreter mode *** Apr 11 16:26:00.318262 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: spawned uWSGI master process (pid: 102932) Apr 11 16:26:00.318455 dv-cinder-837165-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 11 16:26:00.320595 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: spawned uWSGI worker 1 (pid: 102933, cores: 1) Apr 11 16:26:00.320595 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: spawned uWSGI worker 2 (pid: 102934, cores: 1) Apr 11 16:26:00.320595 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 11 16:26:01.500853 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 16:26:01.516980 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 16:26:02.350915 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 16:26:02.350915 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: from cryptography.utils import int_from_bytes Apr 11 16:26:02.351198 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 16:26:02.351198 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: from cryptography.utils import int_from_bytes Apr 11 16:26:02.351198 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 16:26:02.351198 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: from cryptography.utils import int_from_bytes Apr 11 16:26:02.351413 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 16:26:02.351413 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: from cryptography.utils import int_from_bytes Apr 11 16:26:04.844219 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 16:26:04.844831 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 16:26:04.844940 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 16:26:04.845317 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 16:26:04.845577 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 16:26:04.845952 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.846151 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 16:26:04.846599 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.846697 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 16:26:04.846780 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.846891 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 16:26:04.847038 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.847280 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 16:26:04.847414 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.847496 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 16:26:04.847622 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.847939 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.848073 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.848265 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.848409 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.848580 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.848712 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.848862 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.848975 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.849199 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.849343 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.849476 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.849571 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837165-2-iscsi {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.849820 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.849976 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.850091 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.850191 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.850430 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.850572 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.850677 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.850775 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.850986 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.851129 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.851299 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837165-2-iscsi {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.851392 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.851594 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.851727 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.851928 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.852143 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.852648 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.852796 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.852915 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.853027 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.853137 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.853240 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.853351 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.853471 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.853616 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.853794 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.854101 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.854197 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.854427 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.854527 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.854726 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.854815 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.855032 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.855164 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.855327 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.855462 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.855861 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.855995 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837165-2-iscsi {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.856185 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.856384 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.856514 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.856709 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.856810 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.857030 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.857183 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.857350 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.857501 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.857661 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.857795 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.858072 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837165-2-iscsi {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.858170 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.858388 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.858486 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.858697 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.858787 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.859003 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.859091 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.859298 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.859391 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.859610 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.859732 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.859949 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.860037 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.860248 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.860335 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.860552 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.860636 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.860855 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.860943 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.861167 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.861254 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.861468 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.861564 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.861764 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.861849 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.862007 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.862157 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.862310 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.862458 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.862624 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.862764 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.862939 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.863066 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.863254 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.863380 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.863499 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.863701 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.863793 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.864002 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.864132 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.864247 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.864352 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.864550 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.864644 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.864867 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.864952 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.865183 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.865277 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.865498 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.865588 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.865745 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.865831 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.865996 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.866094 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.866308 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.866394 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.866623 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.866755 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.866927 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.867020 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.867229 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.867314 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.867529 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.867614 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.867858 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.867949 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.868157 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.868255 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.868457 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.868563 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.868758 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.868845 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.869059 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.869144 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.869370 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.869463 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.869681 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.869773 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.869994 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.870078 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.870295 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.870389 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.870608 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.870692 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.870910 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.871003 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.871265 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.871413 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.871568 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.871842 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.872484 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.872882 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.872972 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.873063 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.873131 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.873194 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.873257 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.873257 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.873384 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.873599 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.873899 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.873986 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.874198 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.874292 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.874498 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.874595 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.874792 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.874886 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.875092 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.875185 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.875395 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.875524 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.875716 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.875807 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.876018 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.876116 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.876303 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.876389 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.876601 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.876695 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.876898 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.876983 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.877198 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.877285 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.877496 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.877582 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.877797 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.877894 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.878099 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.878190 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.878395 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.878479 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.878690 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.878783 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.878990 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.879084 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.879291 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.879376 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.879592 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.879704 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.879915 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.879999 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.880215 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.880313 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.880515 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.880654 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.880812 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.880905 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.881108 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.881193 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.881417 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.881515 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.881719 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.881804 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.882019 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.882104 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.882318 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.882411 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.882613 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.882697 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.882910 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.882995 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.883214 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.883311 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.883514 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.883598 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.883835 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.883935 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.884134 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.884233 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.884430 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.884515 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.884727 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.884820 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.885025 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.885111 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.885319 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.885449 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.885616 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.885704 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.885907 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.885993 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.886205 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.886290 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.886504 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.886589 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.886838 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.886932 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.887138 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.887231 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.887436 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.887521 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.887774 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.887877 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.888076 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.888159 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.888374 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.888467 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.888682 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.888767 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.888978 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.889062 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.889276 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.889368 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.889567 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.889653 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.889879 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.889963 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.890195 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.890292 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.890498 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.890583 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.890799 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.890884 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.891099 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.891186 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.891412 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:26:04.891504 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.891736 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.891857 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.892053 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.892147 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.892366 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.892451 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.892691 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.892775 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.893002 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.893087 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.893312 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.893401 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.893623 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.893707 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.894237 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.894322 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.894544 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.894647 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.894861 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.894953 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.895166 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.895253 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.895468 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.895553 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.895795 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.895884 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.896114 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.896202 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.896429 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.896515 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.896750 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.896843 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.897061 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.897146 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.897365 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.897453 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.897670 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.897765 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.897972 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.898067 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.898284 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.898368 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.898608 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.898702 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.898914 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.899007 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.899220 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.899305 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.899523 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.899616 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.899853 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.899939 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.900157 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.900255 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.900461 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.900548 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.900766 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.900859 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.901092 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.901178 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.901396 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.901506 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.901701 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.901787 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.902005 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.902088 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.902332 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.902473 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.902660 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.902750 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.902966 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.903051 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.903271 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.903441 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.903577 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.903783 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.903906 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.904088 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.904212 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.904389 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.904518 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.904692 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.904845 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.905007 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.905154 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.905295 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.905465 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.905617 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.905772 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.905919 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.906081 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.906251 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.906385 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.906553 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.906691 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.906859 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.906998 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.907164 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.907305 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.907468 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.907583 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.907791 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.907908 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.908097 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.908212 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.908401 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.908498 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.908700 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.908818 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.909014 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.909139 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.909438 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.909648 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.909762 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.909946 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.910040 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.910326 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.910412 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.910632 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.910725 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.910937 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.911023 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.911234 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.911319 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.911539 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.911626 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.911866 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.911952 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.912165 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.912263 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.912472 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.912571 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.912776 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.912861 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.913074 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.913173 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.913384 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.913470 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.913681 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.913764 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.913980 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.914075 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.914289 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.914381 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.914593 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.914678 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.914899 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.914993 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.915204 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.915291 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.915507 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.915592 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.915835 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.915964 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.916135 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.916229 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.916438 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.916530 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.916736 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.916823 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.917040 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.917125 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.917339 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.917424 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.917641 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.917728 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.918017 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.918153 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.918325 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.918458 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.918647 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.918765 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.919017 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.919105 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.919322 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.919419 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.919622 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.919731 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.919942 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.920030 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.920248 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.920344 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.920545 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.920631 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.920845 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.920938 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.921144 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.921287 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.921444 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.921530 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.921743 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.921828 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.922061 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.922191 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.922366 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.922451 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.922666 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.922752 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.922965 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.923052 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.923263 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.923349 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.923574 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.923710 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.923907 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.923996 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.924223 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.924308 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.924544 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.924638 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.924843 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.924929 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.925149 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.925235 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.925456 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.925540 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.925759 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.925852 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.926063 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.926147 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.926366 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.926459 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.926671 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.926755 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.926977 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.927070 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.927296 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.927389 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.927602 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.927706 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.927941 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.928027 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.928246 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.928346 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.928557 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.928642 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.928860 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.928953 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.929167 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.929261 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.929463 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.929546 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.929766 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.929850 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.930078 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.930177 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.930381 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.930466 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.930694 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.930779 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.930997 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.931084 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.931300 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.931385 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.931604 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.931752 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.931928 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.932014 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.932224 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.932354 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.932526 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.932611 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.932832 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.932919 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.933145 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.933230 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.933449 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.933534 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.934000 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.934272 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.934371 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.934581 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.934676 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.934904 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.934991 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.935210 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.935295 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.935509 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.935595 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.935839 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.935929 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.936148 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.936235 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.936465 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.936551 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.936770 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.936856 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.937075 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.937160 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.937373 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.937458 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.937685 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.937770 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.937991 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.938076 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.938295 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.938389 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.938595 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.938680 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.938895 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.938986 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.939208 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.939348 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.939512 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.939615 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.939846 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.939933 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.940155 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.940250 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.940455 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.940539 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.940751 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.940835 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.941063 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.941162 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.941368 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.941452 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.941666 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.941750 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.941967 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.942061 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.942266 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.942402 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.942581 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.942666 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.942888 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.942982 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.943187 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.943272 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.943500 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.943586 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.943825 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.943919 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.944130 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.944216 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.944440 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.944524 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.944743 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.944828 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.945041 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.945127 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.945344 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.945448 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.945644 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.945731 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.945944 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.946067 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.946250 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.946344 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.946562 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.946647 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.946866 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.946987 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.947171 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.947265 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.947474 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.947567 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.947804 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.947892 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.948110 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.948209 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.948414 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.948501 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.948711 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.948795 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.949015 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.949109 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.949351 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.949604 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.949930 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.950024 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.950247 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.950334 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.950563 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.950672 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.950877 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.950971 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.951200 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.951286 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.951510 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.951595 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.951949 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.952071 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.952195 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.952302 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.952487 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.952585 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.952737 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.952833 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.953054 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.953151 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.953401 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.953618 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.953704 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.953952 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.954045 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.954267 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.954361 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.954585 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.954715 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.954885 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.954982 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.955193 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.955279 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.955494 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.955588 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.955823 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.955926 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.956125 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.956211 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.956431 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.956526 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.956740 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.956850 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.957038 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.957125 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.957345 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.957430 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.957646 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.957779 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.957934 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.958015 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.958235 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.958322 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.958538 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.958624 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.958837 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.958925 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.959135 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.959228 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.959442 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.959528 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.959766 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.959857 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.960073 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.960170 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.960386 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.960481 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.960688 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.960783 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.960995 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.961081 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.961295 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.961388 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.961614 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.961699 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.961916 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.962001 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.962213 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.962307 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.962508 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.962654 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.962805 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.962902 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.963105 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.963207 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.963402 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.963489 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.963730 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.963819 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.964037 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.964134 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.964343 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.964437 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.964644 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.964730 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.965012 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.965102 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.965355 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.965448 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.965653 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.965810 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.965965 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.966113 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.966276 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.966413 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.966575 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.966719 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.966875 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.967025 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.967183 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.967324 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.967486 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.967658 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.967811 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.967961 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.968119 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.968267 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.968418 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.968572 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.968727 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.968868 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.969026 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.969172 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.969324 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.969475 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.969620 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.969785 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.969923 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.970089 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.970227 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.970387 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.970530 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.970685 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.970846 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.970989 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.971152 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.971293 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.971452 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.971591 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.971773 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.971920 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.972077 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.972217 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.972377 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.972529 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.972673 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.972829 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.972978 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.973129 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.973293 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.973432 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.973604 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.973737 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.973902 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.974042 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.974204 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.974340 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.974503 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.974658 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.974802 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.974963 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.975098 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.975262 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.975401 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.975561 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.975719 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.975911 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.976040 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.976212 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.976335 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.976514 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.976642 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.976819 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.976906 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.977137 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.977231 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.977449 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.977535 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.977747 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.977832 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.978053 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.978150 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.978349 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.978434 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.978647 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.978731 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.978945 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.979040 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.979251 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.979337 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.979548 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.979695 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.979873 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.979973 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.980175 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.980303 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.980504 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.980725 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.980862 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.981034 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.981208 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.981339 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.981481 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.981641 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.981782 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.981955 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.982085 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.982265 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.982386 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.982574 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.982726 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.982873 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.983028 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.983174 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.983380 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.983490 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.983711 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.983814 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.984024 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.984110 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.984340 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.984424 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.984648 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.984735 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.984957 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.985042 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.985266 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.985365 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.985566 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.985651 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.985877 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.985962 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.986183 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.986344 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.986481 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.986563 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.986778 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.986864 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.987076 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.987170 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.987380 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.987465 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.987709 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.987798 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.988018 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.988116 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.988321 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.988407 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.988624 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.988709 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.988929 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.989023 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.989230 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.989314 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.989527 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.989611 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.989834 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.989919 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.990138 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.990227 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.990433 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.990517 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.990738 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.990825 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.991035 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.991120 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.991339 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.991425 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.991670 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.991759 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.991969 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.992095 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.992275 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.992405 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.992580 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.992709 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.992889 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.993012 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.993196 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.993318 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.993497 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.993624 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.993815 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.993940 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.994122 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.994250 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.994422 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.994548 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.994726 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.994959 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.995052 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.995265 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.995352 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.995570 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.995675 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.995901 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.996057 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.996254 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.996466 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.996553 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.996740 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.996946 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.997045 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.997161 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.997314 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.997462 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.997621 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.997761 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.997934 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.998059 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.998245 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.998378 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.998546 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.998677 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.998954 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.999041 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.999260 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.999386 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.999569 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.999717 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:04.999900 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.000016 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.000201 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.000482 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.000576 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.000732 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.000818 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.001038 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.001124 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.001356 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.001449 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.001673 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.001766 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.001974 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.002060 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.002279 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.002365 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.002580 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.002666 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.002889 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.002979 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.003216 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.003311 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.003537 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.003623 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.003872 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.003963 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.004184 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.004352 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.004484 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.004572 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.004803 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.004890 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.005121 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.005208 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.005431 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.005530 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.005746 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.005832 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.006072 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.006157 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.006385 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.006480 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.006691 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.006778 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.007011 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.007098 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.007331 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.007427 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.007654 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.007744 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.007960 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.008044 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.008263 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.008361 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.008562 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.008648 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.008863 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.008956 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.009179 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.009267 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.009478 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.009572 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.009783 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.009890 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.010087 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.010214 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.010390 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.010520 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.010688 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.010838 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.010985 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.011159 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.011386 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.011474 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.011740 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.011898 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.012066 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.012185 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.012358 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.012524 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.012672 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.012771 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.012988 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.013075 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.013287 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.013374 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.013605 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.013699 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.013908 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.014004 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.014208 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.014301 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.014506 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.014606 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.014803 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.014888 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.015121 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.015207 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.015420 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.015507 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.015762 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.015849 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.016071 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.016156 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.016387 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.016475 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.016691 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.016777 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.016991 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.017076 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.017312 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.017399 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.017617 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.017704 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.017918 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.018011 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.018219 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.018307 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.018516 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.018601 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.019124 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.019224 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.019429 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.019515 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.019751 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.019841 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.020053 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.020152 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.020350 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.020437 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.020654 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.020739 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.020950 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.021044 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.021249 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.021383 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.021546 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.021633 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.021863 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.021960 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.022162 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.022250 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.022481 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.022567 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.022784 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.022879 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.023081 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.023168 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.023381 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.023467 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.023697 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.023787 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.023998 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.024083 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.024303 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.024389 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.024599 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.024687 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.024897 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.024982 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.025196 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.025282 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.025918 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.026055 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.026162 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.026264 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.026367 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.026484 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.026590 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.026694 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.026796 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.026905 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.027019 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.027130 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.027267 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.027437 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.027673 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.027821 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.027977 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.028104 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.028307 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.028434 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.028619 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.028730 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.028936 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.029061 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.029245 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.029357 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.029558 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.029676 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.029877 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.030091 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.030202 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.030414 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.030544 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.031167 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.031255 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.031340 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.031419 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.031498 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.031585 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.031742 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.031833 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.031913 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.031999 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.032220 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.032315 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.032523 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.032611 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.032829 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.032923 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.033133 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.033232 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.033455 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.033711 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.033805 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.034040 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.034126 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.034351 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.034447 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.034659 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.034745 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.034970 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.035055 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.035277 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.035370 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.035584 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.035690 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.035917 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.036016 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.036224 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.036310 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.036534 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.036621 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.036837 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.036934 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.037148 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.037250 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.037479 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.037620 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.037767 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.037902 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.038118 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.038356 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.038452 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.038659 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.038760 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.038972 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.039065 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.039294 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.039386 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.039604 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.039740 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.039923 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.040008 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.040250 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.040342 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.040546 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.040660 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.040999 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.041095 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.041164 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.041237 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.041438 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.041532 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.041750 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.041836 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.042072 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.042201 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.042365 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.042566 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.042661 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.042879 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.043032 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.043237 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.043375 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.043551 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.043666 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.043986 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.044112 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.044305 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.044422 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.044620 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.044708 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.044938 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.045024 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.045238 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.045325 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.045545 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.045631 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.045852 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.046065 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.046166 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.046375 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.046462 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.046700 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.046787 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.047034 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.047124 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.047322 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.047409 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.047671 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.047762 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.047961 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.048058 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.048281 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.048490 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.048577 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.048838 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.049124 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.049220 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.049308 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.049453 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.049539 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.049754 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.049841 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.050069 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.050154 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.050369 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.050453 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.050667 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.050755 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.050972 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.051057 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.051274 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.051364 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.051584 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.051832 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.051920 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.052177 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.052265 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.052486 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.052580 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.052793 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.052881 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.053097 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.053184 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.053399 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.053486 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.053702 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.053802 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.053996 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.054081 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.054307 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.054393 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.054607 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.054692 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.054907 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.054993 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.055205 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.055293 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.055503 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.055589 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.055877 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.055969 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.056128 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.056212 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.056405 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.056492 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.056699 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.056794 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.057004 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.057098 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.057298 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.057385 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.057601 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.057695 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.057901 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.057987 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.058198 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.058339 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.058492 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.058629 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.058847 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.058932 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.059146 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.059231 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.059555 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.059675 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.059884 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.059970 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.060183 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.060266 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.060491 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.060588 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.060791 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.060879 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.061097 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.061192 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.061399 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.061505 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.061702 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.061797 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.061999 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.062084 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.062304 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.062398 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.062650 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.062855 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.062968 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.063184 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.063349 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.063501 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.063600 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.063854 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.063947 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.064182 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.064283 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.064484 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.064571 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.064787 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.064874 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.065088 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.065175 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.065414 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.065512 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.065723 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.065810 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.066030 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.066251 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.066420 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.066588 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.066674 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.066908 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.067004 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.067212 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.067297 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.067517 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.067668 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.067847 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.067935 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.068153 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.068240 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.068457 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.068558 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.068760 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.068848 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.069062 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.069148 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.069370 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.069463 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.069676 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.069762 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.069983 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.070068 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.070289 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.070383 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.070596 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.070688 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.070902 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.070989 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.071205 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.071306 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.071507 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.071602 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.071833 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.071920 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.072136 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.072243 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.072440 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.072534 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.072752 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.072839 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.073055 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.073142 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.073351 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.073437 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.073691 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.073813 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.074006 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.074092 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.074363 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.074596 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.074691 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.074919 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.075018 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.075227 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.075313 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.075541 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.075626 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.075878 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.075977 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.076184 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.076270 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.076499 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.076591 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.076799 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.076885 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.077120 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.077211 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.077454 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.077541 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.077777 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.077864 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.078095 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.078181 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.078398 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.078536 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.078698 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.078787 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.078997 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.079084 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.079301 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.079395 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.079616 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.079763 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.079944 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.080031 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.080240 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.080333 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.080540 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.080626 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.080847 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.080934 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.081146 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.081243 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.081443 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.081537 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.081742 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.081828 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.082039 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.082126 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.082342 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.082510 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.082637 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.082721 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.082921 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.083009 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.083219 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.083338 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.083516 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.083601 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.083836 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.083964 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.084134 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.084219 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.084463 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.084629 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.084760 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.084901 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.085018 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.085103 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.085312 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.085437 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.085610 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.085698 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.085906 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.085991 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.086200 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.086293 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.086498 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.086583 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.086796 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.086882 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.087111 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.087211 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.087399 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.087491 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.087722 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.087814 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.088024 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.088125 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.088321 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.088408 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.088620 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.088706 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.088916 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.089003 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.089245 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.089330 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.089570 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.089655 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.089934 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.090100 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.090236 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.090334 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.090543 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.090630 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.090848 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.090963 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.091154 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.091276 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.091460 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.091597 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.091808 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.091942 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.092130 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.092254 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.092432 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.092561 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.092753 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.092890 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.093065 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.093199 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.093388 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.093507 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.093701 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.093814 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.094007 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.094121 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.094376 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.094481 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.094635 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.094723 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.094939 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.095027 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.095251 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.095338 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.095560 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.095703 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.095922 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.096010 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.096236 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.096325 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.096549 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.096635 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.096859 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.096943 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.097166 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.097266 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.097488 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.097573 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.097793 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.097887 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.098098 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.098185 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.098411 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.098498 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.098716 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.098812 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.099020 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.099116 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.099339 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.099427 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.099664 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.099768 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.099982 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.100076 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.100221 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 16:26:05.100309 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.100609 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.100931 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.101269 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.101577 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.101916 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.102238 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.102547 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.102853 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.103156 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:26:05.103394 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 16:26:05.122955 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG oslo_db.sqlalchemy.engines [None req-a7211194-9be3-4899-af3b-8a7d7b418c6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102934) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 16:26:05.125689 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_db.sqlalchemy.engines [None req-0e571eb5-4d94-436d-bf7c-46665c8d39bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 16:26:05.185820 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.context [None req-a7211194-9be3-4899-af3b-8a7d7b418c6b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a14129a4-d92e-4c5c-b5b2-11cea54345dd(cell1) {{(pid=102934) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 16:26:05.187231 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.context [None req-0e571eb5-4d94-436d-bf7c-46665c8d39bd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a14129a4-d92e-4c5c-b5b2-11cea54345dd(cell1) {{(pid=102933) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 16:26:05.191669 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG oslo_concurrency.lockutils [None req-a7211194-9be3-4899-af3b-8a7d7b418c6b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:26:05.193011 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-0e571eb5-4d94-436d-bf7c-46665c8d39bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:26:05.193270 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG oslo_concurrency.lockutils [None req-a7211194-9be3-4899-af3b-8a7d7b418c6b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:26:05.194087 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG oslo_concurrency.lockutils [None req-a7211194-9be3-4899-af3b-8a7d7b418c6b None None] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:26:05.194608 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-0e571eb5-4d94-436d-bf7c-46665c8d39bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:26:05.195398 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-0e571eb5-4d94-436d-bf7c-46665c8d39bd None None] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:26:05.196043 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG oslo_concurrency.lockutils [None req-a7211194-9be3-4899-af3b-8a7d7b418c6b None None] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:26:05.197327 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-0e571eb5-4d94-436d-bf7c-46665c8d39bd None None] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:26:05.206508 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG oslo_db.sqlalchemy.engines [None req-a7211194-9be3-4899-af3b-8a7d7b418c6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102934) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 16:26:05.207771 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_db.sqlalchemy.engines [None req-0e571eb5-4d94-436d-bf7c-46665c8d39bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 16:26:05.210601 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_db.sqlalchemy.engines [None req-0e571eb5-4d94-436d-bf7c-46665c8d39bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 16:26:05.349260 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG oslo_db.sqlalchemy.engines [None req-a7211194-9be3-4899-af3b-8a7d7b418c6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102934) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 16:26:05.370990 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG oslo_db.sqlalchemy.engines [None req-a7211194-9be3-4899-af3b-8a7d7b418c6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102934) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 16:26:05.373797 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_db.sqlalchemy.engines [None req-0e571eb5-4d94-436d-bf7c-46665c8d39bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 16:26:05.820240 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: WARNING keystonemiddleware.auth_token [None req-a7211194-9be3-4899-af3b-8a7d7b418c6b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 16:26:05.822218 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: WARNING keystonemiddleware.auth_token [None req-0e571eb5-4d94-436d-bf7c-46665c8d39bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 16:26:05.826890 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: WARNING keystonemiddleware.auth_token [None req-a7211194-9be3-4899-af3b-8a7d7b418c6b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 16:26:05.829037 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: WARNING keystonemiddleware.auth_token [None req-0e571eb5-4d94-436d-bf7c-46665c8d39bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 16:26:06.045370 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: WARNING keystonemiddleware.auth_token [None req-a7211194-9be3-4899-af3b-8a7d7b418c6b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 16:26:06.050174 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: WARNING keystonemiddleware.auth_token [None req-0e571eb5-4d94-436d-bf7c-46665c8d39bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 16:26:06.050655 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: WARNING keystonemiddleware.auth_token [None req-a7211194-9be3-4899-af3b-8a7d7b418c6b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 16:26:06.055315 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: WARNING keystonemiddleware.auth_token [None req-0e571eb5-4d94-436d-bf7c-46665c8d39bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 16:26:06.055845 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a185cf69c0 pid: 102934 (default app) Apr 11 16:26:06.057915 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-a7211194-9be3-4899-af3b-8a7d7b418c6b None None] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:26:06.059106 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-a7211194-9be3-4899-af3b-8a7d7b418c6b None None] 10.222.0.65 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001782 Apr 11 16:26:06.059545 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 788 bytes} [Mon Apr 11 16:26:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:26:06.061356 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a185cf69c0 pid: 102933 (default app) Apr 11 16:27:26.439430 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-a7211194-9be3-4899-af3b-8a7d7b418c6b None None] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:27:26.440469 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-a7211194-9be3-4899-af3b-8a7d7b418c6b None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001807 Apr 11 16:27:26.441013 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 2/2] 10.222.0.65 () {54 vars in 930 bytes} [Mon Apr 11 16:27:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:27:26.875558 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-5ad890ef-b737-4eaf-8161-b10c5d815ec8 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:27:26.907181 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-5ad890ef-b737-4eaf-8161-b10c5d815ec8 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.457553 Apr 11 16:27:26.907920 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 1/3] 10.222.0.65 () {60 vars in 1291 bytes} [Mon Apr 11 16:27:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:27:29.354926 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-a7211194-9be3-4899-af3b-8a7d7b418c6b None None] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:27:29.356051 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-a7211194-9be3-4899-af3b-8a7d7b418c6b None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001731 Apr 11 16:27:29.356708 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 3/4] 10.222.0.65 () {54 vars in 930 bytes} [Mon Apr 11 16:27:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:27:29.421636 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-54d63026-9b56-40ce-96b5-efb3ed64e6c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 256, "name": "cirros256", "id": "c1", "disk": 1, "vcpus": 1}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:29.442428 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:27:29.442428 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: warnings.warn(msg) Apr 11 16:27:29.473425 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-54d63026-9b56-40ce-96b5-efb3ed64e6c3 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.110687 Apr 11 16:27:29.474315 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 2/5] 10.222.0.65 () {64 vars in 1282 bytes} [Mon Apr 11 16:27:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 16:27:29.709346 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-8f29e60f-d4dd-433c-a888-12f05e56c916 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:29.712243 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:27:29.712243 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: warnings.warn(msg) Apr 11 16:27:29.770586 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-8f29e60f-d4dd-433c-a888-12f05e56c916 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287934 Apr 11 16:27:29.776800 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 4/6] 10.222.0.65 () {64 vars in 1335 bytes} [Mon Apr 11 16:27:29 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:27:32.141198 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-54d63026-9b56-40ce-96b5-efb3ed64e6c3 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:27:32.142548 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-54d63026-9b56-40ce-96b5-efb3ed64e6c3 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001805 Apr 11 16:27:32.142948 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 3/7] 10.222.0.65 () {54 vars in 930 bytes} [Mon Apr 11 16:27:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:27:32.248722 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-e5c587a7-1efd-4066-8162-8389a95a21ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d1", "disk": 5, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:32.266675 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:27:32.266675 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: warnings.warn(msg) Apr 11 16:27:32.285681 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-e5c587a7-1efd-4066-8162-8389a95a21ac admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.136732 Apr 11 16:27:32.286339 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 5/8] 10.222.0.65 () {64 vars in 1282 bytes} [Mon Apr 11 16:27:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 16:27:32.297997 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-3c12d5cf-bcbf-4a82-b022-e84596e0b85c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:32.299560 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:27:32.299560 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: warnings.warn(msg) Apr 11 16:27:32.334649 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-3c12d5cf-bcbf-4a82-b022-e84596e0b85c admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040116 Apr 11 16:27:32.347661 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 4/9] 10.222.0.65 () {64 vars in 1335 bytes} [Mon Apr 11 16:27:32 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:27:34.709532 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-e5c587a7-1efd-4066-8162-8389a95a21ac admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:27:34.710538 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-e5c587a7-1efd-4066-8162-8389a95a21ac admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Apr 11 16:27:34.710917 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 6/10] 10.222.0.65 () {54 vars in 930 bytes} [Mon Apr 11 16:27:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:27:34.771674 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-3691fb9c-9105-4645-a1db-8287e5c84b1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d2"}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:34.792378 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-3691fb9c-9105-4645-a1db-8287e5c84b1c admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075284 Apr 11 16:27:34.793164 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 5/11] 10.222.0.65 () {64 vars in 1282 bytes} [Mon Apr 11 16:27:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 16:27:34.805206 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-f6a26161-facb-4709-a972-623b5911e5fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:34.834896 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-f6a26161-facb-4709-a972-623b5911e5fb admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033556 Apr 11 16:27:34.847966 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 7/12] 10.222.0.65 () {64 vars in 1335 bytes} [Mon Apr 11 16:27:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:27:37.269236 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-3691fb9c-9105-4645-a1db-8287e5c84b1c admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:27:37.270252 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-3691fb9c-9105-4645-a1db-8287e5c84b1c admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Apr 11 16:27:37.270673 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 6/13] 10.222.0.65 () {54 vars in 930 bytes} [Mon Apr 11 16:27:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:27:37.337225 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-10f64187-117e-4463-81a8-240685b892c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:37.361211 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-10f64187-117e-4463-81a8-240685b892c4 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083117 Apr 11 16:27:37.361740 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 8/14] 10.222.0.65 () {64 vars in 1282 bytes} [Mon Apr 11 16:27:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:27:37.374052 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-7dfd0919-84ea-4ab4-a5f4-2ddb697f6688 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:37.397505 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-7dfd0919-84ea-4ab4-a5f4-2ddb697f6688 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027385 Apr 11 16:27:37.398200 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 7/15] 10.222.0.65 () {64 vars in 1335 bytes} [Mon Apr 11 16:27:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:27:39.899301 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-10f64187-117e-4463-81a8-240685b892c4 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:27:39.900358 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-10f64187-117e-4463-81a8-240685b892c4 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Apr 11 16:27:39.900996 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 9/16] 10.222.0.65 () {54 vars in 930 bytes} [Mon Apr 11 16:27:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:27:39.965759 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-ab57839e-33da-40de-b60d-0340b6da6128 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "d4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "name": "ds4G", "swap": 0}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:39.983616 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-ab57839e-33da-40de-b60d-0340b6da6128 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076408 Apr 11 16:27:39.984471 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 8/17] 10.222.0.65 () {64 vars in 1282 bytes} [Mon Apr 11 16:27:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 16:27:39.998273 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-66e0821c-99d4-447e-8289-e1d834a649f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:40.029652 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-66e0821c-99d4-447e-8289-e1d834a649f8 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036068 Apr 11 16:27:40.031105 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 10/18] 10.222.0.65 () {64 vars in 1335 bytes} [Mon Apr 11 16:27:39 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:27:42.569261 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-ab57839e-33da-40de-b60d-0340b6da6128 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:27:42.570264 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-ab57839e-33da-40de-b60d-0340b6da6128 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Apr 11 16:27:42.570691 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 9/19] 10.222.0.65 () {54 vars in 930 bytes} [Mon Apr 11 16:27:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:27:42.649416 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-c1324fee-3ed4-4789-b178-87bb2af6b203 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:27:42.679665 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-c1324fee-3ed4-4789-b178-87bb2af6b203 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.100302 Apr 11 16:27:42.680108 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 11/20] 10.222.0.65 () {60 vars in 1291 bytes} [Mon Apr 11 16:27:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:27:45.134004 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-ab57839e-33da-40de-b60d-0340b6da6128 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:27:45.135131 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-ab57839e-33da-40de-b60d-0340b6da6128 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001656 Apr 11 16:27:45.135541 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 10/21] 10.222.0.65 () {54 vars in 930 bytes} [Mon Apr 11 16:27:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:27:45.204633 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-e5eb51c8-c880-4b8f-8d46-1f7596a15098 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:45.224306 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-e5eb51c8-c880-4b8f-8d46-1f7596a15098 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.082343 Apr 11 16:27:45.224822 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 12/22] 10.222.0.65 () {64 vars in 1282 bytes} [Mon Apr 11 16:27:45 2022] POST /compute/v2.1/flavors => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:27:45.237031 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-1508d270-248d-498d-9ab0-4fbd6a2f4193 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:45.272261 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-1508d270-248d-498d-9ab0-4fbd6a2f4193 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038973 Apr 11 16:27:45.273005 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 11/23] 10.222.0.65 () {64 vars in 1332 bytes} [Mon Apr 11 16:27:45 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:27:47.736918 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-e5eb51c8-c880-4b8f-8d46-1f7596a15098 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:27:47.737931 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-e5eb51c8-c880-4b8f-8d46-1f7596a15098 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Apr 11 16:27:47.738330 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 13/24] 10.222.0.65 () {54 vars in 930 bytes} [Mon Apr 11 16:27:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:27:47.805032 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-97b21aa5-6a2c-4506-ae6f-903c8a32d30f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "name": "m1.small", "disk": 20, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:47.822332 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-97b21aa5-6a2c-4506-ae6f-903c8a32d30f admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078005 Apr 11 16:27:47.822939 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 12/25] 10.222.0.65 () {64 vars in 1282 bytes} [Mon Apr 11 16:27:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:27:47.834919 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-3cd2ea43-c390-4362-9e70-8a6e23f99624 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:47.860141 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-3cd2ea43-c390-4362-9e70-8a6e23f99624 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028945 Apr 11 16:27:47.860792 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 14/26] 10.222.0.65 () {64 vars in 1332 bytes} [Mon Apr 11 16:27:47 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:27:50.385891 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-97b21aa5-6a2c-4506-ae6f-903c8a32d30f admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:27:50.386927 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-97b21aa5-6a2c-4506-ae6f-903c8a32d30f admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Apr 11 16:27:50.387334 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 13/27] 10.222.0.65 () {54 vars in 930 bytes} [Mon Apr 11 16:27:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:27:50.454296 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-18cb789d-b2ee-461d-ae6b-6a406332053e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "disk": 40, "name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:50.475363 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-18cb789d-b2ee-461d-ae6b-6a406332053e admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.081029 Apr 11 16:27:50.476121 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 15/28] 10.222.0.65 () {64 vars in 1282 bytes} [Mon Apr 11 16:27:50 2022] POST /compute/v2.1/flavors => generated 406 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:27:50.490727 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-93ddbd4b-2b6a-492d-afc5-77cb3c5872f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:50.519376 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-93ddbd4b-2b6a-492d-afc5-77cb3c5872f2 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032713 Apr 11 16:27:50.520223 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 14/29] 10.222.0.65 () {64 vars in 1332 bytes} [Mon Apr 11 16:27:50 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:27:52.914322 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-18cb789d-b2ee-461d-ae6b-6a406332053e admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:27:52.915317 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-18cb789d-b2ee-461d-ae6b-6a406332053e admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Apr 11 16:27:52.915843 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 16/30] 10.222.0.65 () {54 vars in 930 bytes} [Mon Apr 11 16:27:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:27:52.972545 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-b3f640ca-5ae1-4fb2-a726-358b95f6d89e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.large", "disk": 80, "id": "4"}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:52.990505 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-b3f640ca-5ae1-4fb2-a726-358b95f6d89e admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.068665 Apr 11 16:27:52.991078 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 15/31] 10.222.0.65 () {64 vars in 1282 bytes} [Mon Apr 11 16:27:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:27:53.003064 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-b7ebc9a1-37da-477d-9b1c-e444ce279d63 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:53.026375 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-b7ebc9a1-37da-477d-9b1c-e444ce279d63 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026959 Apr 11 16:27:53.032176 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 17/32] 10.222.0.65 () {64 vars in 1332 bytes} [Mon Apr 11 16:27:52 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:27:55.618138 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-b3f640ca-5ae1-4fb2-a726-358b95f6d89e admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:27:55.619388 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-b3f640ca-5ae1-4fb2-a726-358b95f6d89e admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001667 Apr 11 16:27:55.620068 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 16/33] 10.222.0.65 () {54 vars in 930 bytes} [Mon Apr 11 16:27:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:27:55.687866 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-c697e26a-234f-413c-8615-2e237ec2140b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "vcpus": 8, "swap": 0}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:55.707330 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-c697e26a-234f-413c-8615-2e237ec2140b admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.081077 Apr 11 16:27:55.707896 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 18/34] 10.222.0.65 () {64 vars in 1282 bytes} [Mon Apr 11 16:27:55 2022] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:27:55.719581 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-fc920af7-cb00-496a-bcab-bd270dbd06f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:27:55.744728 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-fc920af7-cb00-496a-bcab-bd270dbd06f5 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028140 Apr 11 16:27:55.745912 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 17/35] 10.222.0.65 () {64 vars in 1332 bytes} [Mon Apr 11 16:27:55 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:28:19.979670 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-c697e26a-234f-413c-8615-2e237ec2140b admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:19.980678 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-c697e26a-234f-413c-8615-2e237ec2140b admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Apr 11 16:28:19.981050 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 19/36] 10.222.0.65 () {54 vars in 930 bytes} [Mon Apr 11 16:28:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:28:20.043560 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-4220f14f-41fd-48e8-b414-1e3b452eb089 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:20.060805 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-4220f14f-41fd-48e8-b414-1e3b452eb089 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073431 Apr 11 16:28:20.061370 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 18/37] 10.222.0.65 () {60 vars in 1291 bytes} [Mon Apr 11 16:28:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:28:21.426717 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-c697e26a-234f-413c-8615-2e237ec2140b admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:21.427689 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-c697e26a-234f-413c-8615-2e237ec2140b admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Apr 11 16:28:21.428088 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 20/38] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Apr 11 16:28:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:28:21.633329 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-9e29017b-a916-4d98-aeb2-8bdda1e78bb2 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:21.639274 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.wsgi [None req-9e29017b-a916-4d98-aeb2-8bdda1e78bb2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 11 16:28:21.639799 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-9e29017b-a916-4d98-aeb2-8bdda1e78bb2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:28:21.640588 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-9e29017b-a916-4d98-aeb2-8bdda1e78bb2 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062208 Apr 11 16:28:21.641427 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 19/39] 10.222.0.65 () {60 vars in 1190 bytes} [Mon Apr 11 16:28:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 11 16:28:21.651602 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-03187cd2-1d2c-48ec-9b03-224632b00e70 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:21.672867 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-03187cd2-1d2c-48ec-9b03-224632b00e70 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025141 Apr 11 16:28:21.673400 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 21/40] 10.222.0.65 () {60 vars in 1210 bytes} [Mon Apr 11 16:28:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:28:21.683129 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-83f77794-8330-40b2-a396-80b26aaa7201 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:21.704105 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-83f77794-8330-40b2-a396-80b26aaa7201 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024497 Apr 11 16:28:21.704654 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 20/41] 10.222.0.65 () {60 vars in 1210 bytes} [Mon Apr 11 16:28:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:28:21.714675 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-2cfb5f9b-d038-466c-9f33-5a6ee3da0d6b admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:21.720628 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.wsgi [None req-2cfb5f9b-d038-466c-9f33-5a6ee3da0d6b admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 11 16:28:21.721187 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-2cfb5f9b-d038-466c-9f33-5a6ee3da0d6b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:28:21.721965 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-2cfb5f9b-d038-466c-9f33-5a6ee3da0d6b admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011575 Apr 11 16:28:21.722467 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 22/42] 10.222.0.65 () {60 vars in 1190 bytes} [Mon Apr 11 16:28:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 11 16:28:22.990664 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-83f77794-8330-40b2-a396-80b26aaa7201 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:22.991713 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-83f77794-8330-40b2-a396-80b26aaa7201 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Apr 11 16:28:22.992110 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 21/43] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Apr 11 16:28:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:28:23.185440 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-e06fd0eb-a92c-4626-9850-10eea713ef6e admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:23.190873 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.wsgi [None req-e06fd0eb-a92c-4626-9850-10eea713ef6e admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 11 16:28:23.191399 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-e06fd0eb-a92c-4626-9850-10eea713ef6e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:28:23.192223 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-e06fd0eb-a92c-4626-9850-10eea713ef6e admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.064411 Apr 11 16:28:23.192752 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 23/44] 10.222.0.65 () {60 vars in 1190 bytes} [Mon Apr 11 16:28:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 11 16:28:23.202932 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-51faf0ad-ae33-4480-8211-603644d12c89 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:23.216941 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-51faf0ad-ae33-4480-8211-603644d12c89 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017766 Apr 11 16:28:23.217485 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 22/45] 10.222.0.65 () {60 vars in 1210 bytes} [Mon Apr 11 16:28:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:28:23.229921 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-5e8e0a98-11e9-4a94-b406-6319440093e5 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:23.244713 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-5e8e0a98-11e9-4a94-b406-6319440093e5 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019119 Apr 11 16:28:23.245263 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 24/46] 10.222.0.65 () {60 vars in 1210 bytes} [Mon Apr 11 16:28:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:28:23.259255 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-909ab573-5f3a-4311-88cf-ced89adef743 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:23.264884 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.wsgi [None req-909ab573-5f3a-4311-88cf-ced89adef743 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 11 16:28:23.265448 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-909ab573-5f3a-4311-88cf-ced89adef743 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:28:23.266556 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-909ab573-5f3a-4311-88cf-ced89adef743 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013006 Apr 11 16:28:23.267106 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 23/47] 10.222.0.65 () {60 vars in 1190 bytes} [Mon Apr 11 16:28:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 11 16:28:24.536144 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-5e8e0a98-11e9-4a94-b406-6319440093e5 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:24.537151 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-5e8e0a98-11e9-4a94-b406-6319440093e5 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Apr 11 16:28:24.537550 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 25/48] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Apr 11 16:28:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:28:24.734059 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-9a4f1a71-a39c-4aea-8f5d-cf923e60abc4 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:24.739385 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.wsgi [None req-9a4f1a71-a39c-4aea-8f5d-cf923e60abc4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 11 16:28:24.739960 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-9a4f1a71-a39c-4aea-8f5d-cf923e60abc4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:28:24.740735 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-9a4f1a71-a39c-4aea-8f5d-cf923e60abc4 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.068011 Apr 11 16:28:24.741233 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 24/49] 10.222.0.65 () {60 vars in 1193 bytes} [Mon Apr 11 16:28:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 11 16:28:24.755308 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-9010e344-8d06-49ba-a24c-3ca57bca7dba admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:24.770514 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-9010e344-8d06-49ba-a24c-3ca57bca7dba admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020658 Apr 11 16:28:24.771349 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 26/50] 10.222.0.65 () {60 vars in 1210 bytes} [Mon Apr 11 16:28:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:28:24.784315 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-7f91ec1b-4d86-4c69-8894-cdc2e0251057 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:24.799490 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-7f91ec1b-4d86-4c69-8894-cdc2e0251057 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021393 Apr 11 16:28:24.800048 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 25/51] 10.222.0.65 () {60 vars in 1210 bytes} [Mon Apr 11 16:28:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:28:24.809238 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-6c6ca4e9-7c7c-459c-a482-c04a3261bd32 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:24.814557 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.wsgi [None req-6c6ca4e9-7c7c-459c-a482-c04a3261bd32 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 11 16:28:24.815100 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-6c6ca4e9-7c7c-459c-a482-c04a3261bd32 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:28:24.815920 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-6c6ca4e9-7c7c-459c-a482-c04a3261bd32 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010237 Apr 11 16:28:24.816406 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 27/52] 10.222.0.65 () {60 vars in 1193 bytes} [Mon Apr 11 16:28:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 11 16:28:26.086065 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-7f91ec1b-4d86-4c69-8894-cdc2e0251057 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:26.087119 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-7f91ec1b-4d86-4c69-8894-cdc2e0251057 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Apr 11 16:28:26.087518 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 26/53] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Apr 11 16:28:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:28:26.292150 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-cad049e2-0747-4ad3-8bf9-680117e0a6c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:28:26.314481 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-cad049e2-0747-4ad3-8bf9-680117e0a6c4 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.090034 Apr 11 16:28:26.315026 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 28/54] 10.222.0.65 () {64 vars in 1235 bytes} [Mon Apr 11 16:28:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:28:27.595188 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-7f91ec1b-4d86-4c69-8894-cdc2e0251057 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:27.596243 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-7f91ec1b-4d86-4c69-8894-cdc2e0251057 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Apr 11 16:28:27.596633 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 27/55] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Apr 11 16:28:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:28:27.792796 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-05b4c760-d01d-4118-8428-6c0c1a30637e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:28:27.811930 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-05b4c760-d01d-4118-8428-6c0c1a30637e admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.076229 Apr 11 16:28:27.812774 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 29/56] 10.222.0.65 () {64 vars in 1235 bytes} [Mon Apr 11 16:28:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:28:29.067107 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-7f91ec1b-4d86-4c69-8894-cdc2e0251057 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:29.068169 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-7f91ec1b-4d86-4c69-8894-cdc2e0251057 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Apr 11 16:28:29.068566 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 28/57] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Apr 11 16:28:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:28:29.260522 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-51bf955f-0785-428c-9fac-d3146fd15f9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:28:29.291736 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-51bf955f-0785-428c-9fac-d3146fd15f9c admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.087054 Apr 11 16:28:29.292214 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 30/58] 10.222.0.65 () {64 vars in 1235 bytes} [Mon Apr 11 16:28:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:28:30.558244 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-7f91ec1b-4d86-4c69-8894-cdc2e0251057 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:30.559271 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-7f91ec1b-4d86-4c69-8894-cdc2e0251057 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Apr 11 16:28:30.559754 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 29/59] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Apr 11 16:28:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:28:30.773871 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-9a419d21-527e-43c4-949b-90ab9022f8f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:28:30.795496 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-9a419d21-527e-43c4-949b-90ab9022f8f4 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.075469 Apr 11 16:28:30.796075 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 31/60] 10.222.0.65 () {64 vars in 1235 bytes} [Mon Apr 11 16:28:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:28:32.067006 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-7f91ec1b-4d86-4c69-8894-cdc2e0251057 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:32.068048 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-7f91ec1b-4d86-4c69-8894-cdc2e0251057 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Apr 11 16:28:32.068422 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 30/61] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Apr 11 16:28:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:28:32.272896 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-9f949ec8-1781-4701-8c99-4aa231d747b6 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:28:32.298202 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-9f949ec8-1781-4701-8c99-4aa231d747b6 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.086972 Apr 11 16:28:32.298640 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 32/62] 10.222.0.65 () {60 vars in 1202 bytes} [Mon Apr 11 16:28:32 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:29:36.419017 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-7f91ec1b-4d86-4c69-8894-cdc2e0251057 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:29:36.420020 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-7f91ec1b-4d86-4c69-8894-cdc2e0251057 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Apr 11 16:29:36.420438 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 31/63] 10.222.0.65 () {54 vars in 930 bytes} [Mon Apr 11 16:29:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:29:36.486839 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-e0b93f43-d1cb-4c44-b3d7-5ebed1855c9b admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:29:36.507109 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-e0b93f43-d1cb-4c44-b3d7-5ebed1855c9b admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.080172 Apr 11 16:29:36.507687 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 33/64] 10.222.0.65 () {60 vars in 1291 bytes} [Mon Apr 11 16:29:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:29:36.531878 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-ece3b07f-cfe0-4b29-ab3c-4a3f58f1e33c admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:29:36.545294 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-ece3b07f-cfe0-4b29-ab3c-4a3f58f1e33c admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018838 Apr 11 16:29:36.545856 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 32/65] 10.222.0.65 () {60 vars in 1282 bytes} [Mon Apr 11 16:29:36 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:29:36.561406 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-9bd539af-51ae-473a-810f-ddba93735634 admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:29:36.573025 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-9bd539af-51ae-473a-810f-ddba93735634 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017713 Apr 11 16:29:36.573785 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 34/66] 10.222.0.65 () {60 vars in 1285 bytes} [Mon Apr 11 16:29:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:29:36.585830 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-7025daad-018b-4037-afb0-59a6a3909e8a admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:29:36.593981 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-7025daad-018b-4037-afb0-59a6a3909e8a admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011947 Apr 11 16:29:36.594555 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 33/67] 10.222.0.65 () {60 vars in 1285 bytes} [Mon Apr 11 16:29:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:29:36.606918 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-7653c223-c552-4070-abea-f2512600719b admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:29:36.615332 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-7653c223-c552-4070-abea-f2512600719b admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012061 Apr 11 16:29:36.616220 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 35/68] 10.222.0.65 () {60 vars in 1282 bytes} [Mon Apr 11 16:29:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:31:19.174459 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-035ed087-9c2f-418a-9cda-04384864f08a tempest-verify_tempest_config-386757535 tempest-verify_tempest_config-386757535-project] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:31:19.176556 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-035ed087-9c2f-418a-9cda-04384864f08a tempest-verify_tempest_config-386757535 tempest-verify_tempest_config-386757535-project] 10.222.0.65 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.115982 Apr 11 16:31:19.177094 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 34/69] 10.222.0.65 () {58 vars in 1133 bytes} [Mon Apr 11 16:31:19 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:33:09.860330 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-7653c223-c552-4070-abea-f2512600719b admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:33:09.861331 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-7653c223-c552-4070-abea-f2512600719b admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Apr 11 16:33:09.861724 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 36/70] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Apr 11 16:33:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:33:10.128441 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-8d4534b0-2b99-4790-a1c0-1b34f8519120 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:33:10.129734 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:33:10.129734 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: warnings.warn(msg) Apr 11 16:33:10.130931 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-8d4534b0-2b99-4790-a1c0-1b34f8519120 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:33:10.131365 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-8d4534b0-2b99-4790-a1c0-1b34f8519120 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:33:10.132197 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-8d4534b0-2b99-4790-a1c0-1b34f8519120 admin admin] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:33:10.132625 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-8d4534b0-2b99-4790-a1c0-1b34f8519120 admin admin] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:33:10.168249 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-8d4534b0-2b99-4790-a1c0-1b34f8519120 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.162887 Apr 11 16:33:10.168826 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 35/71] 10.222.0.65 () {60 vars in 1193 bytes} [Mon Apr 11 16:33:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:33:11.470529 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-7653c223-c552-4070-abea-f2512600719b admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:33:11.471536 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-7653c223-c552-4070-abea-f2512600719b admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Apr 11 16:33:11.472147 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 37/72] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Apr 11 16:33:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:33:11.667505 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-65d02bbc-8c92-4bab-bc05-bfe11860461a admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:33:11.668813 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:33:11.668813 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: warnings.warn(msg) Apr 11 16:33:11.670018 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-65d02bbc-8c92-4bab-bc05-bfe11860461a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:33:11.670454 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-65d02bbc-8c92-4bab-bc05-bfe11860461a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:33:11.671236 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-65d02bbc-8c92-4bab-bc05-bfe11860461a admin admin] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:33:11.671670 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-65d02bbc-8c92-4bab-bc05-bfe11860461a admin admin] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:33:11.690778 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-65d02bbc-8c92-4bab-bc05-bfe11860461a admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081558 Apr 11 16:33:11.691274 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 36/73] 10.222.0.65 () {60 vars in 1193 bytes} [Mon Apr 11 16:33:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:33:23.395528 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-7653c223-c552-4070-abea-f2512600719b admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:33:23.396580 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-7653c223-c552-4070-abea-f2512600719b admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Apr 11 16:33:23.396950 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 38/74] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Apr 11 16:33:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:33:23.592279 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-ce97f20d-3c7d-480f-bddf-f96ff04511e6 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:33:23.593541 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:33:23.593541 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: warnings.warn(msg) Apr 11 16:33:23.594714 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-ce97f20d-3c7d-480f-bddf-f96ff04511e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:33:23.595135 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-ce97f20d-3c7d-480f-bddf-f96ff04511e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:33:23.595928 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-ce97f20d-3c7d-480f-bddf-f96ff04511e6 admin admin] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:33:23.596366 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-ce97f20d-3c7d-480f-bddf-f96ff04511e6 admin admin] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:33:23.620443 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-ce97f20d-3c7d-480f-bddf-f96ff04511e6 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083189 Apr 11 16:33:23.620920 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 37/75] 10.222.0.65 () {60 vars in 1193 bytes} [Mon Apr 11 16:33:23 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:33:24.895327 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: DEBUG nova.api.openstack.wsgi [None req-7653c223-c552-4070-abea-f2512600719b admin admin] Calling method '>' {{(pid=102934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:33:24.896368 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: INFO nova.api.openstack.requestlog [None req-7653c223-c552-4070-abea-f2512600719b admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Apr 11 16:33:24.896768 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: [pid: 102934|app: 0|req: 39/76] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Apr 11 16:33:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:33:25.091466 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG nova.api.openstack.wsgi [None req-8eeb9afc-5a0e-4a1f-bb87-199285100156 admin admin] Calling method '>' {{(pid=102933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:33:25.092739 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:33:25.092739 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: warnings.warn(msg) Apr 11 16:33:25.093922 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-8eeb9afc-5a0e-4a1f-bb87-199285100156 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:33:25.094356 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-8eeb9afc-5a0e-4a1f-bb87-199285100156 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:33:25.095138 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-8eeb9afc-5a0e-4a1f-bb87-199285100156 admin admin] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:33:25.095556 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: DEBUG oslo_concurrency.lockutils [None req-8eeb9afc-5a0e-4a1f-bb87-199285100156 admin admin] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:33:25.117028 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: INFO nova.api.openstack.requestlog [None req-8eeb9afc-5a0e-4a1f-bb87-199285100156 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081252 Apr 11 16:33:25.117608 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: [pid: 102933|app: 0|req: 38/77] 10.222.0.65 () {60 vars in 1193 bytes} [Mon Apr 11 16:33:25 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:34:24.770946 dv-cinder-837165-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 11 16:34:24.777837 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: Mon Apr 11 16:34:24 2022 - graceful shutdown triggered... Apr 11 16:34:24.778473 dv-cinder-837165-2-iscsi devstack@n-api.service[102933]: Gracefully killing worker 1 (pid: 102933)... Apr 11 16:34:24.778830 dv-cinder-837165-2-iscsi devstack@n-api.service[102934]: Gracefully killing worker 2 (pid: 102934)... Apr 11 16:34:25.784891 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: worker 1 buried after 1 seconds Apr 11 16:34:25.784891 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: worker 2 buried after 1 seconds Apr 11 16:34:25.784891 dv-cinder-837165-2-iscsi devstack@n-api.service[102932]: goodbye to uWSGI. Apr 11 16:34:25.786546 dv-cinder-837165-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 11 16:34:25.787156 dv-cinder-837165-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 11 16:34:25.789933 dv-cinder-837165-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 11 16:34:25.808048 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 11 16:34:25.825660 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Apr 11 16:34:25 2022] *** Apr 11 16:34:25.825660 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 11 16:34:25.825660 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 11 16:34:25.825660 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: nodename: dv-cinder-837165-2-iscsi Apr 11 16:34:25.825660 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: machine: x86_64 Apr 11 16:34:25.825660 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: clock source: unix Apr 11 16:34:25.825660 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: pcre jit disabled Apr 11 16:34:25.825660 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: detected number of CPU cores: 4 Apr 11 16:34:25.825660 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: current working directory: / Apr 11 16:34:25.825660 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: detected binary path: /usr/bin/uwsgi-core Apr 11 16:34:25.825660 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: your processes number limit is 47680 Apr 11 16:34:25.825660 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: your memory page size is 4096 bytes Apr 11 16:34:25.825660 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: detected max file descriptor number: 2048 Apr 11 16:34:25.825660 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: lock engine: pthread robust mutexes Apr 11 16:34:25.826779 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: thunder lock: enabled Apr 11 16:34:25.826779 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 11 16:34:25.826779 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 11 16:34:25.873929 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: Python main interpreter initialized at 0x5641c5ea89c0 Apr 11 16:34:25.873929 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: python threads support enabled Apr 11 16:34:25.873929 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: your server socket listen backlog is limited to 100 connections Apr 11 16:34:25.873929 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: your mercy for graceful operations on workers is 90 seconds Apr 11 16:34:25.874400 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: mapped 403077 bytes (393 KB) for 2 cores Apr 11 16:34:25.874400 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: *** Operational MODE: preforking *** Apr 11 16:34:25.874666 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: *** uWSGI is running in multiple interpreter mode *** Apr 11 16:34:25.874666 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: spawned uWSGI master process (pid: 123756) Apr 11 16:34:25.874915 dv-cinder-837165-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 11 16:34:25.875531 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: spawned uWSGI worker 1 (pid: 123773, cores: 1) Apr 11 16:34:25.877349 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: spawned uWSGI worker 2 (pid: 123774, cores: 1) Apr 11 16:34:25.877349 dv-cinder-837165-2-iscsi devstack@n-api.service[123756]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 11 16:34:27.097426 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 16:34:27.101255 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 16:34:28.029502 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 16:34:28.029502 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: from cryptography.utils import int_from_bytes Apr 11 16:34:28.029849 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 16:34:28.029849 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: from cryptography.utils import int_from_bytes Apr 11 16:34:28.033363 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 16:34:28.033363 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: from cryptography.utils import int_from_bytes Apr 11 16:34:28.033700 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 16:34:28.033700 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: from cryptography.utils import int_from_bytes Apr 11 16:34:30.379796 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 16:34:30.380288 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 16:34:30.380600 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 16:34:30.380957 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 16:34:30.381208 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 16:34:30.381593 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.381913 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.382578 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.382895 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.383222 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.383530 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.383893 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.384210 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.384539 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.384796 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.385107 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.385463 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837165-2-iscsi {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.385782 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.386151 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.386570 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.386889 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.387193 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.387511 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.387744 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 16:34:30.388149 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.388234 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 16:34:30.388311 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.388559 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 16:34:30.388921 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 16:34:30.389178 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 16:34:30.389874 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.390000 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.390232 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.390416 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.390581 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.390882 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.391269 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.391511 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.391814 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.392186 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.392380 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.392808 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.392911 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.393353 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.393475 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.393934 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.394050 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.394491 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.394617 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.394819 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.395179 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.395475 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837165-2-iscsi {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.395588 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837165-2-iscsi {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.395888 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.396218 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.396325 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.396548 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.396871 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.397044 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.397180 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.397554 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.397796 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.397907 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.398369 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.398622 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.398746 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.398974 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.399287 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.399451 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.399628 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.400012 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.400233 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.400347 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.400670 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.400945 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.401119 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.401440 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.401755 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.401909 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.402168 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837165-2-iscsi {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.402492 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.402664 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.402804 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.403124 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.403400 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.403548 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.404015 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.404131 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.404453 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.404726 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.404843 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.405094 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.405406 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.405579 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.405738 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.406060 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.406297 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.406411 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.406691 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.406996 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.407217 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.407327 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.407611 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.407940 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.408054 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.408250 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.408557 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.408772 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.408861 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.409107 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.409453 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.409558 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.409781 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.410108 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.410272 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.410380 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.410602 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.410924 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.411035 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.411244 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.411553 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.411787 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.411882 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.412183 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.412476 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.412580 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.412788 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.413096 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.413332 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.413444 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.413705 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.413894 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.414014 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.414329 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.414544 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.414661 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.414950 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.415191 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.415312 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.415685 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.415944 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.416080 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.416578 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.416697 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.416936 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.417258 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.417418 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.417569 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.417978 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.418232 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.418412 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.418833 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.419221 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.419370 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.419844 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.419964 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.420044 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.420220 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.420476 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.420931 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.421049 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.421544 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.421676 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.422727 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.422727 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.423219 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.423494 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.423860 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.424204 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.424345 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.424534 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.424830 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.424944 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.425157 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.425364 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.425472 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.425624 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.425754 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.426083 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.426356 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.426484 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.426694 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.426910 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.427347 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.427516 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.427998 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.428271 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.428389 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.428613 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.428723 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.428930 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.429051 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.429289 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.429399 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.429568 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.429660 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.429903 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.430001 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.430189 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.430284 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.430500 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.430609 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.430813 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.430927 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.431120 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.431250 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.431433 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.431763 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.431960 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.432117 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.432307 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.432535 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.432644 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.432958 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.433128 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.433285 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.433538 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.433699 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.433853 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.434027 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.434180 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.434322 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.434464 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.434613 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.434754 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.434895 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.435050 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.435193 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.435340 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.435520 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.435718 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.435928 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.436208 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.436364 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.436507 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.436649 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.436798 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.436954 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.437106 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.437255 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.437405 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.437546 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.437693 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.438367 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.438540 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.438719 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.438863 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.439003 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.439261 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.439420 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.439608 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.439802 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.439955 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.441477 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.443003 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.448582 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.448792 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.448970 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.449156 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.449331 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.449484 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.449627 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.449768 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.449909 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.450065 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.450209 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.450359 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.450501 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.450651 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.451475 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.451659 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.451822 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.451966 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.452106 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.452246 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.452398 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.452548 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.452745 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.452905 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.453200 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.453461 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.453620 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.453620 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.453911 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.454051 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.454191 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.454341 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.454590 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.454746 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.454900 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.455049 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.455190 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.455344 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.455487 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.455628 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.455804 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.455947 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.456088 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.456264 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.456408 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.456601 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.456748 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.456978 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.457129 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.457280 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:34:30.457434 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.457576 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.457736 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.457877 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.458030 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.458172 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.458320 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.458463 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.458623 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.458775 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.458921 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.459075 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.459225 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.459374 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.459524 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.459699 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.459848 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.460001 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.460144 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.460285 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.460433 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.460574 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.460765 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.461458 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.461784 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.461936 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.462086 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.462248 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.462391 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.462543 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.462773 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.462926 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.463075 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.463800 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.463975 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.464129 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.464273 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.464421 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.464563 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.464757 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.464926 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.465078 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.465221 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.465327 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.465414 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.465544 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.465689 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.465817 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.465944 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.466069 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.466208 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.466335 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.467116 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.467263 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.467474 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.467604 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.467769 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.467908 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.468053 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.468190 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.468326 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.468461 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.468588 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.468863 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.468996 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.469133 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.469261 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.469386 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.469512 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.469647 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.469773 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.469899 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.470032 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.470160 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.470287 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.470422 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.470557 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.470683 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.470817 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.470952 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.471674 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.471987 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.472129 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.472258 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.472384 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.472509 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.472649 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.472837 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.472973 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.473108 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.473243 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.473617 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.474016 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.474162 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.474396 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.474538 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.474747 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.474886 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.475028 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.475157 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.475283 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.475411 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.475538 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.475680 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.475828 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.475965 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.476097 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.476231 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.476358 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.476500 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.476635 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.476635 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.476926 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.477062 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.477189 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.477189 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.477451 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.477451 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.477451 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.477819 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.477946 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.477946 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.478200 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.478334 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.478471 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.478600 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.478725 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.478865 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.478865 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.479266 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.479400 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.479400 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.479673 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.479803 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.479929 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.480069 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.480069 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.481011 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.481158 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.481158 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.481944 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.482237 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.482237 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.482488 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.482628 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.482628 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.482875 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.482999 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.483132 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.483281 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.483415 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.483567 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.483929 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.484215 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.484215 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.484474 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.484608 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.484743 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.484873 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.484873 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.485169 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.485306 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.485521 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.485658 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.485785 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.485920 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.485920 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.486179 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.486306 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.486306 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.486544 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.486670 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.486809 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.486947 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.486947 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.487192 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.487326 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.487326 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.487572 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.487812 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.487943 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.488078 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.488078 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.488316 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.488457 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.488457 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.488715 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.488842 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.488842 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.489079 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.489214 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.489347 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.489474 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.489599 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.489724 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.489865 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.490020 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.490295 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.490463 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.490633 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.490769 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.490769 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.491019 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.491158 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.491285 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.491435 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.491435 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.491435 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.491435 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.492426 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.492557 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.492557 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.492803 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.492942 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.493077 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.493213 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.493380 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.493510 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.493510 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.493777 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.494046 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.494046 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.494435 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.494566 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.494783 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.495037 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.495037 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.495332 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.496052 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.496206 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.496351 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.496351 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.496600 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.496736 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.496736 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.497126 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.497269 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.497269 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.497530 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.497657 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.497657 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.497902 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.498083 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.498083 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.498430 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.498544 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.498653 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.498762 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.498762 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.498762 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.499074 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.499229 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.499229 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.499449 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.499560 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.499805 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.499938 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.500066 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.500193 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.500193 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.500567 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.500765 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.500765 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.501051 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.501186 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.501327 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.501456 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.501456 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.502062 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.502315 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.502459 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.502699 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.502699 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.503022 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.503151 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.503277 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.503491 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.503629 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.503775 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.503775 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.504214 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.504386 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.504526 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.504661 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.504661 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.504909 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.505168 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.505168 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.505429 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.505566 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.505693 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.505821 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.505955 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.506116 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.506254 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.506381 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.506381 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.506665 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.506791 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.506926 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.507051 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.507051 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.507673 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.507822 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.507951 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.508090 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.508249 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.508377 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.508377 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.508652 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.508786 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.508926 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.509053 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.509188 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.509315 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.509315 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.509588 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.509798 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.509926 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.510063 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.510063 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.510380 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.510521 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.510663 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.510790 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.510790 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.511043 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.511178 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.511313 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.511447 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.511447 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.511700 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.511860 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.511860 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.512517 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.512702 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.512702 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.513081 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.513221 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.513221 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.513467 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.513593 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.513718 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.513988 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.513988 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.514464 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.514603 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.514603 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.514859 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.514995 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.515122 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.515382 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.515382 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.515628 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.515846 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.515846 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.516757 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.516888 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.516888 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.517163 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.517299 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.517443 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.517571 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.517697 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.518649 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.518649 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.518908 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.519036 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.519036 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.519319 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.519449 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.519579 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.519966 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.519966 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.520235 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.520389 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.520518 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.520683 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.520683 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.520960 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.521145 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.521276 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.521408 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.521408 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.521666 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.521800 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.521941 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.522443 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.522732 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.522874 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.522874 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.523268 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.523418 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.523418 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.523687 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.523829 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.523972 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.524174 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.525014 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.525150 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.525276 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.525536 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.525536 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.525795 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.525977 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.525977 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.526273 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.526408 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.526543 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.526745 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.526745 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.527264 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.527394 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.527394 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.527699 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.527850 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.527987 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.528115 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.528115 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.528361 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.528487 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.528751 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.528883 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.528883 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.529163 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.529289 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.529425 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.529560 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.529560 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.529807 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.529935 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.530070 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.530205 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.530205 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.530205 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.530575 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.530700 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.530700 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.531001 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.531137 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.531137 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.531675 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.531804 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.531804 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.532060 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.532212 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.532959 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.533172 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.533172 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.533633 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.533737 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.533737 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.534012 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.534105 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.534205 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.534300 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.534300 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.534455 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.534566 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.534566 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.534950 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.535050 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.535136 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.535228 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.535228 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.535382 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.535473 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.535680 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.535829 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.535829 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.536001 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.536094 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.536191 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.536277 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.536277 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.536277 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.536503 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.536587 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.536682 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.536767 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.536767 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.536927 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.537075 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.537075 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.537304 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.537402 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.537486 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.537581 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.537581 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.537581 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.537817 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.537910 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.537994 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.538084 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.538084 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.538084 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.538331 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.538415 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.538415 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.538576 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.538665 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.538665 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.538850 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.538937 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.538937 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.538937 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.539189 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.539274 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.539459 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.539559 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.539791 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.539997 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.540091 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.540391 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.540494 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.540714 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.540878 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.541024 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.541309 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.541406 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.541721 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.542044 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.542159 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.542352 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.542522 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.542645 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.542854 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.543085 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.543201 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.543394 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.543489 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.543727 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.543835 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.544033 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.544123 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.544340 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.544429 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.544650 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.544755 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.544966 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.545071 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.545280 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.545381 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.545582 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.545671 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.545941 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.546037 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.546247 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.546338 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.546561 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.546650 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.546885 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.546990 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.547190 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.547287 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.547496 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.547594 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.547828 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.547927 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.548153 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.548250 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.548455 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.548557 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.548756 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.548846 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.549058 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.549146 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.549376 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.549483 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.549680 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.549770 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.549999 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.550096 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.550309 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.550412 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.550623 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.550721 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.550930 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.551020 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.551247 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.551401 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.551563 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.551736 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.551935 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.552052 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.552258 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.552402 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.552551 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.552837 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.552976 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.553125 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.553283 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.553420 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.553580 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.553748 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.553885 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.554027 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.554180 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.554327 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.554466 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.554614 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.554760 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.554920 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.555159 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.555262 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.555349 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.555431 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.555525 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.555769 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.555880 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.556012 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.556178 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.556326 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.556426 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.556649 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.556743 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.557034 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.557139 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.557375 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.557498 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.557749 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.557878 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.558189 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.558524 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.558843 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.559048 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.559169 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.559290 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.559449 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.559566 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.559854 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.560000 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.560169 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.560484 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.560675 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.560803 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.561164 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.561341 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.561509 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.561651 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.561825 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.562146 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.562332 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.562473 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.562640 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.562999 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.563127 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.563221 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.563431 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.563627 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.563871 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.564009 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.564238 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.564346 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.564561 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.564661 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.564885 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.565099 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.565223 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.565307 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.565510 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.565745 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.565883 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.566082 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.566255 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.566354 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.566542 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.566677 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.566858 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.566979 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.567110 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.567294 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.567405 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.567619 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.567796 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.568159 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.568492 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.568805 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.569014 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.569141 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.569378 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.569487 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.569732 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.569895 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.570064 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.570161 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.570377 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.570521 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.570894 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.571054 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.571203 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.571342 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.571470 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.571580 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.571848 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.571985 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.572140 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.572271 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.572407 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.572545 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.572722 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.573248 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.573429 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.573599 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.573599 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.573751 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.574013 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.574136 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.574518 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.574690 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.574800 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.574885 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.575021 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.575158 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.575465 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.575561 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.575674 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.575857 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.575946 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.576176 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.576256 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.576498 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.576587 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.576833 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.576912 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.577156 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.577244 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.577487 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.577578 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.577798 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.577886 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.578113 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.578193 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.578440 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.578529 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.578758 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.578841 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.579074 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.579208 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.579392 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.579474 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.579726 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.579827 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.580044 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.580131 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.580360 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.580441 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.580676 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.580756 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.580982 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.581070 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.581296 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.581376 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.581607 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.581695 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.581919 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.582012 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.582232 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.582492 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.582582 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.582826 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.582906 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.583163 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.583273 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.583457 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.583550 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.583785 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.583867 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.584100 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.584188 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.584410 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.584489 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.584723 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.584888 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.585036 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.585208 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.585350 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.585551 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.585691 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.585876 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.585990 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.586293 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.586617 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.586889 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.587000 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.587255 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.587362 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.587571 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.587787 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.587941 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.588033 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.588253 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.588488 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.588787 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.588938 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.589106 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.589337 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.589545 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.589676 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.589779 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.589855 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.590028 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.590185 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.590346 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.590571 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.590806 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.590936 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.591100 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.591224 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.591317 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.591506 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.591671 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.591845 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.592047 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.592211 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.592402 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.592552 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.592653 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.592739 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.593012 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.593130 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.593387 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.593526 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.593730 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.593893 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.594008 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.594273 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.594407 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.594619 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.594765 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.595100 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.595211 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.595450 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.595567 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.595814 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.595941 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.596138 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.596261 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.596507 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.596893 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.597014 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.597355 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.597557 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.597652 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.597793 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.597885 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.597994 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.598140 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.598309 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.598450 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.598737 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.598967 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.599116 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.599294 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.599394 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.599564 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.599697 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.599786 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.600029 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.600229 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.600322 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.600474 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.600685 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.600846 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.600970 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.601182 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.601420 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.601610 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.601771 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.601944 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.602089 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.602263 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.602415 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.602594 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.602741 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.602925 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.603058 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.603238 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.603368 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.603548 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.603786 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.603921 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.604213 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.604329 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.604504 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.604685 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.604833 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.604927 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.605129 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.605435 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.605529 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.605737 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.605839 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.606047 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.606141 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.606358 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.606464 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.606745 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.606851 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.606950 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.607047 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.607264 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.607366 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.607576 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.607691 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.607909 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.608003 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.608211 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.608306 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.608516 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.608618 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.608827 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.608920 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.609131 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.609224 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.609435 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.609577 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.609740 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.609834 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.610041 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.610136 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.610355 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.610456 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.610658 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.610759 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.610963 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.611056 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.611266 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.611368 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.611575 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.611766 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.611908 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.612015 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.612217 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.612324 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.612583 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.612676 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.612909 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.613009 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.613211 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.613311 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.613512 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.613659 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.613834 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.613947 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.614146 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.614247 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.614467 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.614568 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.614773 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.614872 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.615082 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.615183 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.615387 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.615480 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.615724 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.615821 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.616034 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.616306 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.616477 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.616646 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.616762 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.617093 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.617183 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.617273 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.617364 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.617555 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.617662 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.617861 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.617963 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.618189 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.618283 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.618503 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.618611 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.618811 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.618913 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.619117 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.619218 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.619424 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.619525 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.619796 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.619906 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.620113 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.620247 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.620566 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.620669 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.620885 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.620991 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.621200 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.621303 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.621517 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.621642 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.621830 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.621930 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.622144 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.622246 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.622458 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.622571 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.622772 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.622864 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.623089 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.623189 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.623430 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.623525 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.623770 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.623878 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.624090 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.624205 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.624408 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.624521 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.624722 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.624830 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.625033 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.625131 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.625347 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.625444 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.625657 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.625761 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.625969 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.626222 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.626334 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.626564 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.626662 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.626896 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.627225 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.627225 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.627399 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.627518 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.627650 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.627866 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.627960 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.628187 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.628290 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.628507 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.628601 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.628824 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.628918 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.629143 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.629237 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.629460 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.629554 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.629780 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.629885 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.630104 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.630197 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.630416 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.630508 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.630748 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.630855 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.631066 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.631166 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.631386 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.631492 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.631730 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.631897 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.632038 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.632488 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.632704 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.632798 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.633012 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.633113 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.633361 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.633499 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.633655 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.633772 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.633983 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.634119 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.634303 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.634439 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.634547 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.634652 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.634868 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.634970 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.635195 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.635331 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.635555 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.635747 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.635854 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.636018 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.636166 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.636443 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.636607 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.636711 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.636804 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.637054 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.637388 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.637517 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.637608 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.637701 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.637784 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.637942 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.638079 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.638219 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.638334 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.638551 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.638698 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.638865 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.639002 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.639166 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.639431 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.639532 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.639761 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.639869 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.640067 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.640159 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.640396 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.640489 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.640721 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.640812 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.641039 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.641139 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.641353 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.641452 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.641666 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.641757 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.641981 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.642081 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.642288 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.642388 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.642601 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.642700 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.642913 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.643014 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.643218 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.643310 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.643530 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.643643 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.643878 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.643981 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.644187 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.644277 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.644502 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.644594 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.644810 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.644915 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.645113 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.645348 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.645441 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.645700 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.645800 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.646004 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.646093 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.646335 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.646445 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.646640 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.646747 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.646962 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.647069 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.647274 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.647387 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.647690 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.647788 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.647919 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.648008 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.648227 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.648314 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.648545 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.648635 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.648857 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.648946 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.649162 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.649250 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.649473 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.649564 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.649778 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.649865 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.650088 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.650176 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.650396 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.650486 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.650708 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.650803 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.651057 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.651162 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.651380 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.651476 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.651727 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.651820 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.652056 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.652159 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.652401 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.652497 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.652712 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.652812 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.653018 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.653118 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.653326 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.653422 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.653635 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.653724 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.653941 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.654107 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.654256 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.654351 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.654498 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 16:34:30.654592 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.654857 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.655169 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.655483 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.655813 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.656124 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.656500 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.656830 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.657137 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.657444 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.657759 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.658068 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.658392 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.658708 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.659017 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.659369 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.659720 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.660273 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.660612 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.660939 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.661283 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.661619 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.661931 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.662241 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.662552 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.662877 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.663193 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.663505 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.663859 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.664178 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.664491 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.664803 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.665115 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.665428 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.665740 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.666051 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.666391 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.666828 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.667152 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.667509 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.667866 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.668185 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.668509 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.668829 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.669146 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.669461 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.669770 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.670081 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.670402 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.670733 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.671020 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.671328 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.671794 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.672112 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.672434 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.672963 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.673409 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.673748 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.673859 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.674128 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.675336 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.675336 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.675336 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.675581 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.675826 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.676084 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.676396 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.676747 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.677134 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.677365 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.677670 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.678013 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_db.sqlalchemy.engines [None req-74f80bec-47cd-4cf9-83ed-eb4e83e94a86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 16:34:30.678191 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.678322 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.678594 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.678908 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.679215 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.679523 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.679855 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.680164 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.680474 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.680780 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.681055 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.681361 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.681667 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.681974 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.682312 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.682626 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.682933 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.683261 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.683699 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.684016 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.684324 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.684664 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.685000 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.685319 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.685646 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.685961 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.686286 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.686610 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.686936 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.687262 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.687583 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.688129 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.688475 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.688791 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.689111 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.689429 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.689748 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.690077 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.690381 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.690739 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.691066 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.691385 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.691728 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.692051 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.692373 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.692692 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.693012 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.693345 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.694086 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.694086 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.694276 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.694590 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.694904 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.695246 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.695567 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.695922 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.696252 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.696593 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.696911 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.697263 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.697637 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.698247 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.698919 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.698919 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.699235 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.699547 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:34:30.699821 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 16:34:30.723485 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_db.sqlalchemy.engines [None req-c91c044b-28e6-4af8-9858-5d4a72d2c5ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 16:34:30.742974 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.context [None req-74f80bec-47cd-4cf9-83ed-eb4e83e94a86 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a14129a4-d92e-4c5c-b5b2-11cea54345dd(cell1) {{(pid=123774) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 16:34:30.747617 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-74f80bec-47cd-4cf9-83ed-eb4e83e94a86 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:34:30.749238 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-74f80bec-47cd-4cf9-83ed-eb4e83e94a86 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:34:30.750051 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-74f80bec-47cd-4cf9-83ed-eb4e83e94a86 None None] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:34:30.752038 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-74f80bec-47cd-4cf9-83ed-eb4e83e94a86 None None] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:34:30.763420 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_db.sqlalchemy.engines [None req-74f80bec-47cd-4cf9-83ed-eb4e83e94a86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 16:34:30.765041 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_db.sqlalchemy.engines [None req-74f80bec-47cd-4cf9-83ed-eb4e83e94a86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 16:34:30.788525 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.context [None req-c91c044b-28e6-4af8-9858-5d4a72d2c5ae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a14129a4-d92e-4c5c-b5b2-11cea54345dd(cell1) {{(pid=123773) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 16:34:30.793040 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c91c044b-28e6-4af8-9858-5d4a72d2c5ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:34:30.794620 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c91c044b-28e6-4af8-9858-5d4a72d2c5ae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:34:30.795424 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c91c044b-28e6-4af8-9858-5d4a72d2c5ae None None] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:34:30.797396 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c91c044b-28e6-4af8-9858-5d4a72d2c5ae None None] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:34:30.808964 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_db.sqlalchemy.engines [None req-c91c044b-28e6-4af8-9858-5d4a72d2c5ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 16:34:30.810077 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_db.sqlalchemy.engines [None req-c91c044b-28e6-4af8-9858-5d4a72d2c5ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 16:34:30.923957 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_db.sqlalchemy.engines [None req-74f80bec-47cd-4cf9-83ed-eb4e83e94a86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 16:34:30.969240 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_db.sqlalchemy.engines [None req-c91c044b-28e6-4af8-9858-5d4a72d2c5ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 16:34:31.360594 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: WARNING keystonemiddleware.auth_token [None req-74f80bec-47cd-4cf9-83ed-eb4e83e94a86 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 16:34:31.367280 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: WARNING keystonemiddleware.auth_token [None req-74f80bec-47cd-4cf9-83ed-eb4e83e94a86 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 16:34:31.414829 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: WARNING keystonemiddleware.auth_token [None req-c91c044b-28e6-4af8-9858-5d4a72d2c5ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 16:34:31.421659 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: WARNING keystonemiddleware.auth_token [None req-c91c044b-28e6-4af8-9858-5d4a72d2c5ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 16:34:31.590532 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: WARNING keystonemiddleware.auth_token [None req-74f80bec-47cd-4cf9-83ed-eb4e83e94a86 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 16:34:31.595702 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: WARNING keystonemiddleware.auth_token [None req-74f80bec-47cd-4cf9-83ed-eb4e83e94a86 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 16:34:31.601345 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5641c5ea89c0 pid: 123774 (default app) Apr 11 16:34:31.647381 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: WARNING keystonemiddleware.auth_token [None req-c91c044b-28e6-4af8-9858-5d4a72d2c5ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 16:34:31.652793 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: WARNING keystonemiddleware.auth_token [None req-c91c044b-28e6-4af8-9858-5d4a72d2c5ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 16:34:31.658277 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5641c5ea89c0 pid: 123773 (default app) Apr 11 16:35:17.720952 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a0a87e9e-1388-48b0-996f-27afb604b043 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1054997049", "imageRef": "e989c938-7b7a-445c-aec9-596e81d35104", "flavorRef": "452", "networks": [{"uuid": "e3943ee9-bf44-464a-b993-383db6dad056"}]}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:35:18.664069 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-14ac03d8-994a-46ab-a0c0-afc138fe84b7 tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] Calling method '.version_select at 0x7f7418f2f5e0>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:19.098230 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.network.neutron [None req-a0a87e9e-1388-48b0-996f-27afb604b043 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] validate_networks() for [('e3943ee9-bf44-464a-b993-383db6dad056', None, None, None, None, None)] {{(pid=123774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:35:19.409628 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-14ac03d8-994a-46ab-a0c0-afc138fe84b7 tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/5d62b569-7b87-4f55-bf78-406fc2b3c5fa" status: 200 len: 350 microversion: 2.1 time: 1.094641 Apr 11 16:35:19.410198 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 1/1] 10.222.0.65 () {58 vars in 1244 bytes} [Mon Apr 11 16:35:18 2022] GET /compute/v2.1/os-volumes/5d62b569-7b87-4f55-bf78-406fc2b3c5fa => generated 350 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:35:21.456012 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-905c1043-8823-4261-85ea-6850ba515b98 tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] Calling method '.version_select at 0x7f7418df8940>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:21.548864 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-905c1043-8823-4261-85ea-6850ba515b98 tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/9ca177f0-3792-45b1-adf2-8a1a22807785" status: 200 len: 351 microversion: 2.1 time: 0.097445 Apr 11 16:35:21.549446 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 2/2] 10.222.0.65 () {58 vars in 1244 bytes} [Mon Apr 11 16:35:21 2022] GET /compute/v2.1/os-volumes/9ca177f0-3792-45b1-adf2-8a1a22807785 => generated 351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:35:22.405594 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-a0a87e9e-1388-48b0-996f-27afb604b043 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Flavor limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:35:22.406573 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-a0a87e9e-1388-48b0-996f-27afb604b043 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Image limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:35:22.407173 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-a0a87e9e-1388-48b0-996f-27afb604b043 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Flavor pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:35:22.407916 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-a0a87e9e-1388-48b0-996f-27afb604b043 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Image pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:35:22.408453 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-a0a87e9e-1388-48b0-996f-27afb604b043 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:35:22.439072 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a0a87e9e-1388-48b0-996f-27afb604b043 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:22.440187 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a0a87e9e-1388-48b0-996f-27afb604b043 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:22.442041 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a0a87e9e-1388-48b0-996f-27afb604b043 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:22.443770 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a0a87e9e-1388-48b0-996f-27afb604b043 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:22.506918 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-a0a87e9e-1388-48b0-996f-27afb604b043 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Getting quotas for project 46281803c3eb4cfbaf258d62f8c4d916. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:35:22.514887 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-a0a87e9e-1388-48b0-996f-27afb604b043 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Getting quotas for user fd9e10f29bcf4b6bb2a1674763e2dcf6 and project 46281803c3eb4cfbaf258d62f8c4d916. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:35:22.528581 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a0a87e9e-1388-48b0-996f-27afb604b043 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Going to run 1 instances... {{(pid=123774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:35:22.531680 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a0a87e9e-1388-48b0-996f-27afb604b043 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e989c938-7b7a-445c-aec9-596e81d35104',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:35:22.668245 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a0a87e9e-1388-48b0-996f-27afb604b043 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.048372 Apr 11 16:35:22.669426 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 1/3] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Apr 11 16:35:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 6051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 16:35:22.679056 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f53c4a06-80ac-4925-9715-df99a855654c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:22.679867 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f53c4a06-80ac-4925-9715-df99a855654c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:22.879586 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f53c4a06-80ac-4925-9715-df99a855654c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:22.909136 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f53c4a06-80ac-4925-9715-df99a855654c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1215 microversion: 2.1 time: 0.233765 Apr 11 16:35:22.913014 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 3/4] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:22 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1215 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:23.240726 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-a37ccc7d-39ae-4543-873e-ac9700b8668c tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] Calling method '.version_select at 0x7f7418d6e4c0>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:23.304542 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d04ba8ee-031e-4328-b07f-436298040f9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-358416526", "imageRef": "e989c938-7b7a-445c-aec9-596e81d35104", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:35:23.311046 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-a37ccc7d-39ae-4543-873e-ac9700b8668c tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/b3a60488-f4ac-4fa5-b84b-058dba643e97" status: 200 len: 351 microversion: 2.1 time: 0.074158 Apr 11 16:35:23.314715 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 4/5] 10.222.0.65 () {58 vars in 1244 bytes} [Mon Apr 11 16:35:23 2022] GET /compute/v2.1/os-volumes/b3a60488-f4ac-4fa5-b84b-058dba643e97 => generated 351 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:35:23.328244 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-a3b7b98b-62ec-4230-8a1a-373d54613e8a tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] Calling method '.version_select at 0x7f7418d7d550>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:23.421040 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.network.neutron [None req-d04ba8ee-031e-4328-b07f-436298040f9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] validate_networks() for [('beb37b89-3aa6-44d9-a704-52e8c05a205a', None, None, None, None, None)] {{(pid=123774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:35:23.475567 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-a3b7b98b-62ec-4230-8a1a-373d54613e8a tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.152592 Apr 11 16:35:23.484698 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 5/6] 10.222.0.65 () {58 vars in 1133 bytes} [Mon Apr 11 16:35:23 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:35:23.491261 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-7d3349ee-846a-4bff-b490-96d8e3e711e1 tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] Calling method '.version_select at 0x7f7418d7d5e0>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:23.681876 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-7d3349ee-846a-4bff-b490-96d8e3e711e1 tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.195233 Apr 11 16:35:23.692508 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 6/7] 10.222.0.65 () {58 vars in 1148 bytes} [Mon Apr 11 16:35:23 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:35:23.703187 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-79fa702a-0990-41bc-a3a2-0d70e399cced tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] Calling method '.version_select at 0x7f7418d8d3a0>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:23.828067 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-79fa702a-0990-41bc-a3a2-0d70e399cced tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.133612 Apr 11 16:35:23.835582 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 7/8] 10.222.0.65 () {58 vars in 1133 bytes} [Mon Apr 11 16:35:23 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:23.842088 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-bfc3a2b5-9a50-4534-951f-408a1890881d tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] Calling method '.version_select at 0x7f7418d15040>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:24.016473 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-bfc3a2b5-9a50-4534-951f-408a1890881d tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.179068 Apr 11 16:35:24.017057 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 8/9] 10.222.0.65 () {58 vars in 1166 bytes} [Mon Apr 11 16:35:23 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:35:24.043576 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3a5e3c17-af66-40f2-bea9-ee8957787aee tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:24.044291 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3a5e3c17-af66-40f2-bea9-ee8957787aee tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:24.455762 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3a5e3c17-af66-40f2-bea9-ee8957787aee tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:24.468573 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3a5e3c17-af66-40f2-bea9-ee8957787aee tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1215 microversion: 2.1 time: 0.435645 Apr 11 16:35:24.483270 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 9/10] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:24 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1215 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:24.495808 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-5c5d0c68-7714-4cda-af28-e45ad04455ed tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] Calling method '.version_select at 0x7f7418d7d940>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:24.675977 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-d04ba8ee-031e-4328-b07f-436298040f9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Flavor limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:35:24.676452 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-d04ba8ee-031e-4328-b07f-436298040f9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Image limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:35:24.676860 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-d04ba8ee-031e-4328-b07f-436298040f9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Flavor pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:35:24.677264 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-d04ba8ee-031e-4328-b07f-436298040f9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Image pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:35:24.677704 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-d04ba8ee-031e-4328-b07f-436298040f9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:35:24.703406 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d04ba8ee-031e-4328-b07f-436298040f9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:24.703884 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d04ba8ee-031e-4328-b07f-436298040f9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:24.704846 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d04ba8ee-031e-4328-b07f-436298040f9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:24.705279 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d04ba8ee-031e-4328-b07f-436298040f9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:24.709260 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-5c5d0c68-7714-4cda-af28-e45ad04455ed tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.222359 Apr 11 16:35:24.709802 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 10/11] 10.222.0.65 () {58 vars in 1169 bytes} [Mon Apr 11 16:35:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:35:24.725826 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-772cdbf2-cbae-4470-b9f2-9bd9bfaa2547 tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] Calling method '.version_select at 0x7f7418d15550>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:24.777357 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-d04ba8ee-031e-4328-b07f-436298040f9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Getting quotas for project e396e5cb51e143bb84d76c18dba0d403. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:35:24.788511 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-d04ba8ee-031e-4328-b07f-436298040f9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Getting quotas for user 80a6cb4479a746b2928b5948282f9d54 and project e396e5cb51e143bb84d76c18dba0d403. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:35:24.827343 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d04ba8ee-031e-4328-b07f-436298040f9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Going to run 1 instances... {{(pid=123774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:35:24.830326 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d04ba8ee-031e-4328-b07f-436298040f9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e989c938-7b7a-445c-aec9-596e81d35104',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:35:24.882598 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-772cdbf2-cbae-4470-b9f2-9bd9bfaa2547 tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.160424 Apr 11 16:35:24.890082 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 11/12] 10.222.0.65 () {58 vars in 1154 bytes} [Mon Apr 11 16:35:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:24.894950 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-407e2fcf-0eed-42c7-8d5b-ee7a6d9b1fe6 tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] Calling method '.version_select at 0x7f7418d6ef70>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:24.951679 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d04ba8ee-031e-4328-b07f-436298040f9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.247434 Apr 11 16:35:24.957730 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 2/13] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Apr 11 16:35:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 2254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 16:35:24.965220 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-203facd5-974a-4eaa-a1d6-843fbdba1ce4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:24.965844 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-203facd5-974a-4eaa-a1d6-843fbdba1ce4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:25.144081 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-407e2fcf-0eed-42c7-8d5b-ee7a6d9b1fe6 tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.252143 Apr 11 16:35:25.144670 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 12/14] 10.222.0.65 () {58 vars in 1187 bytes} [Mon Apr 11 16:35:24 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:35:25.152143 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-203facd5-974a-4eaa-a1d6-843fbdba1ce4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:25.158503 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-66979642-5920-4627-8330-178e70c65061 tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] Calling method '.version_select at 0x7f7418d7d040>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:25.193102 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-203facd5-974a-4eaa-a1d6-843fbdba1ce4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1221 microversion: 2.1 time: 0.234147 Apr 11 16:35:25.205336 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 3/15] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:24 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1221 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:25.375386 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-66979642-5920-4627-8330-178e70c65061 tempest-VolumesTestJSON-1300506911 tempest-VolumesTestJSON-1300506911-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.222163 Apr 11 16:35:25.388062 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 13/16] 10.222.0.65 () {58 vars in 1154 bytes} [Mon Apr 11 16:35:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:25.490434 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-3689698a-6e84-4e34-abd2-d65200dd7635 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:25.491446 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-3689698a-6e84-4e34-abd2-d65200dd7635 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:25.695966 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-a4161e4c-4ef1-4916-ba44-906a7a274be4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1513569781", "imageRef": "e989c938-7b7a-445c-aec9-596e81d35104", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:35:25.704688 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-3689698a-6e84-4e34-abd2-d65200dd7635 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:25.712145 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-3689698a-6e84-4e34-abd2-d65200dd7635 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1215 microversion: 2.1 time: 0.227568 Apr 11 16:35:25.714646 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 4/17] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:25 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1215 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:25.954510 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.network.neutron [None req-a4161e4c-4ef1-4916-ba44-906a7a274be4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] validate_networks() for [('beb37b89-3aa6-44d9-a704-52e8c05a205a', None, None, None, None, None)] {{(pid=123773) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:35:26.729459 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-7435be32-74ee-4bbf-b14a-45f9cdc34daf tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:26.730652 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-7435be32-74ee-4bbf-b14a-45f9cdc34daf tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:26.764250 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7435be32-74ee-4bbf-b14a-45f9cdc34daf tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:26.765106 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7435be32-74ee-4bbf-b14a-45f9cdc34daf tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:26.765487 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7435be32-74ee-4bbf-b14a-45f9cdc34daf tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:26.765916 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7435be32-74ee-4bbf-b14a-45f9cdc34daf tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:27.713786 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-7435be32-74ee-4bbf-b14a-45f9cdc34daf tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:27.807252 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-7435be32-74ee-4bbf-b14a-45f9cdc34daf tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1267 microversion: 2.1 time: 1.079760 Apr 11 16:35:27.834489 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 5/18] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:26 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1267 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:28.826789 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-6b0f43cf-bde5-4090-b8c1-7e8b357274e4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:28.827513 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-6b0f43cf-bde5-4090-b8c1-7e8b357274e4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:28.835509 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6b0f43cf-bde5-4090-b8c1-7e8b357274e4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:28.845846 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6b0f43cf-bde5-4090-b8c1-7e8b357274e4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:28.849614 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6b0f43cf-bde5-4090-b8c1-7e8b357274e4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:28.851295 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6b0f43cf-bde5-4090-b8c1-7e8b357274e4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:29.658936 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-6b0f43cf-bde5-4090-b8c1-7e8b357274e4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:29.668314 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-6b0f43cf-bde5-4090-b8c1-7e8b357274e4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1273 microversion: 2.1 time: 0.845625 Apr 11 16:35:29.668920 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 6/19] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:28 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1273 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:35:30.686971 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-667379ef-0b8a-4800-878a-e29505cd99be tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:30.688623 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-667379ef-0b8a-4800-878a-e29505cd99be tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:30.701412 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-667379ef-0b8a-4800-878a-e29505cd99be tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:30.702250 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-667379ef-0b8a-4800-878a-e29505cd99be tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:30.703209 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-667379ef-0b8a-4800-878a-e29505cd99be tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:30.704960 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-667379ef-0b8a-4800-878a-e29505cd99be tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:30.853849 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-a4161e4c-4ef1-4916-ba44-906a7a274be4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Flavor limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:35:30.854975 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-a4161e4c-4ef1-4916-ba44-906a7a274be4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Image limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:35:30.855810 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-a4161e4c-4ef1-4916-ba44-906a7a274be4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Flavor pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:35:30.856584 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-a4161e4c-4ef1-4916-ba44-906a7a274be4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Image pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:35:30.857074 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-a4161e4c-4ef1-4916-ba44-906a7a274be4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:35:30.892791 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a4161e4c-4ef1-4916-ba44-906a7a274be4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:30.893245 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a4161e4c-4ef1-4916-ba44-906a7a274be4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:30.896351 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a4161e4c-4ef1-4916-ba44-906a7a274be4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:30.897969 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a4161e4c-4ef1-4916-ba44-906a7a274be4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:30.996589 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-a4161e4c-4ef1-4916-ba44-906a7a274be4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Getting quotas for project e396e5cb51e143bb84d76c18dba0d403. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:35:31.010458 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-a4161e4c-4ef1-4916-ba44-906a7a274be4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Getting quotas for user 80a6cb4479a746b2928b5948282f9d54 and project e396e5cb51e143bb84d76c18dba0d403. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:35:31.056668 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-a4161e4c-4ef1-4916-ba44-906a7a274be4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Going to run 1 instances... {{(pid=123773) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:35:31.060144 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-a4161e4c-4ef1-4916-ba44-906a7a274be4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e989c938-7b7a-445c-aec9-596e81d35104',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:35:31.234509 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-667379ef-0b8a-4800-878a-e29505cd99be tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:31.246375 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-667379ef-0b8a-4800-878a-e29505cd99be tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1273 microversion: 2.1 time: 0.563751 Apr 11 16:35:31.247518 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 7/20] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:30 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1273 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:31.330367 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-a4161e4c-4ef1-4916-ba44-906a7a274be4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.639367 Apr 11 16:35:31.330945 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 14/21] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Apr 11 16:35:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 5641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 11 16:35:31.342214 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f34b594a-969a-4c47-8fe1-b5e633975cd0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:31.342829 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f34b594a-969a-4c47-8fe1-b5e633975cd0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:31.742379 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f34b594a-969a-4c47-8fe1-b5e633975cd0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:31.761702 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f34b594a-969a-4c47-8fe1-b5e633975cd0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1222 microversion: 2.1 time: 0.423591 Apr 11 16:35:31.780013 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 15/22] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:31 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1222 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:35:32.265321 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d66baa30-2812-4621-a16b-c63e7f6b6b2b tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:32.266215 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d66baa30-2812-4621-a16b-c63e7f6b6b2b tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:32.274659 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-1299faba-dfa5-4e8e-ab0c-c9da66370b63 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Action: 'create', calling method: .version_select at 0x7f741844a4c0>, body: {"keypair": {"name": "tempest-keypair-99754670"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:35:32.282136 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d66baa30-2812-4621-a16b-c63e7f6b6b2b tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:32.287945 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d66baa30-2812-4621-a16b-c63e7f6b6b2b tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:32.290193 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d66baa30-2812-4621-a16b-c63e7f6b6b2b tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:32.295915 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d66baa30-2812-4621-a16b-c63e7f6b6b2b tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:32.448119 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-1299faba-dfa5-4e8e-ab0c-c9da66370b63 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Getting quotas for project fff5d5c8db254085a82ca911ead15f49. Resources: {'key_pairs'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:35:32.470426 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-1299faba-dfa5-4e8e-ab0c-c9da66370b63 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Getting quotas for user 98902ced574b44779b9aec59a2f999fb and project fff5d5c8db254085a82ca911ead15f49. Resources: {'key_pairs'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:35:33.009489 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-1299faba-dfa5-4e8e-ab0c-c9da66370b63 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Getting quotas for project fff5d5c8db254085a82ca911ead15f49. Resources: {'key_pairs'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:35:33.023848 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-1299faba-dfa5-4e8e-ab0c-c9da66370b63 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Getting quotas for user 98902ced574b44779b9aec59a2f999fb and project fff5d5c8db254085a82ca911ead15f49. Resources: {'key_pairs'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:35:33.075595 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-1299faba-dfa5-4e8e-ab0c-c9da66370b63 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 2318 microversion: 2.20 time: 1.822734 Apr 11 16:35:33.077112 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 8/23] 10.222.0.65 () {62 vars in 1198 bytes} [Mon Apr 11 16:35:31 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 1829 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 11 16:35:33.083790 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ca28a9a2-5e6b-4ebc-a260-94693021eefa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:33.084690 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ca28a9a2-5e6b-4ebc-a260-94693021eefa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:33.093563 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ca28a9a2-5e6b-4ebc-a260-94693021eefa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:33.094335 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ca28a9a2-5e6b-4ebc-a260-94693021eefa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:33.099906 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ca28a9a2-5e6b-4ebc-a260-94693021eefa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:33.099906 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ca28a9a2-5e6b-4ebc-a260-94693021eefa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:33.398682 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d66baa30-2812-4621-a16b-c63e7f6b6b2b tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:33.425762 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d66baa30-2812-4621-a16b-c63e7f6b6b2b tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1273 microversion: 2.1 time: 1.164156 Apr 11 16:35:33.426369 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 16/24] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:32 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1273 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:35:34.192054 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ca28a9a2-5e6b-4ebc-a260-94693021eefa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:34.210447 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ca28a9a2-5e6b-4ebc-a260-94693021eefa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1226 microversion: 2.1 time: 1.128794 Apr 11 16:35:34.227070 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 9/25] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:33 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1226 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:34.445498 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-dcbc9bcf-5af1-4417-8c14-4fc20d27f51d tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:34.446229 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-dcbc9bcf-5af1-4417-8c14-4fc20d27f51d tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:34.465097 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dcbc9bcf-5af1-4417-8c14-4fc20d27f51d tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:34.467163 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dcbc9bcf-5af1-4417-8c14-4fc20d27f51d tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:34.470080 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dcbc9bcf-5af1-4417-8c14-4fc20d27f51d tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:34.475997 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dcbc9bcf-5af1-4417-8c14-4fc20d27f51d tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:34.800746 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c88897b4-71bc-4cbb-8b7d-f93e5f4314b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Action: 'create', calling method: .version_select at 0x7f7418406af0>, body: {"keypair": {"name": "tempest-keypair-1654807370"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:35:34.859497 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-c88897b4-71bc-4cbb-8b7d-f93e5f4314b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Getting quotas for project 90215ff8d2af4f1fa9d0137fcb2f881d. Resources: {'key_pairs'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:35:34.875325 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-c88897b4-71bc-4cbb-8b7d-f93e5f4314b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Getting quotas for user d94b4c03d94440e7b92ea1051cb3625e and project 90215ff8d2af4f1fa9d0137fcb2f881d. Resources: {'key_pairs'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:35:35.110833 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-dcbc9bcf-5af1-4417-8c14-4fc20d27f51d tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:35.120918 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-dcbc9bcf-5af1-4417-8c14-4fc20d27f51d tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.681072 Apr 11 16:35:35.128999 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 17/26] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:34 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:35.234456 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c1e1caa0-de96-4a74-ab96-967607f1b0f1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:35.235456 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c1e1caa0-de96-4a74-ab96-967607f1b0f1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:35.251157 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c1e1caa0-de96-4a74-ab96-967607f1b0f1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:35.252036 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c1e1caa0-de96-4a74-ab96-967607f1b0f1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:35.254297 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c1e1caa0-de96-4a74-ab96-967607f1b0f1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:35.256621 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c1e1caa0-de96-4a74-ab96-967607f1b0f1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:35.525558 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-c88897b4-71bc-4cbb-8b7d-f93e5f4314b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Getting quotas for project 90215ff8d2af4f1fa9d0137fcb2f881d. Resources: {'key_pairs'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:35:35.538986 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-c88897b4-71bc-4cbb-8b7d-f93e5f4314b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Getting quotas for user d94b4c03d94440e7b92ea1051cb3625e and project 90215ff8d2af4f1fa9d0137fcb2f881d. Resources: {'key_pairs'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:35:35.568308 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c88897b4-71bc-4cbb-8b7d-f93e5f4314b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.873613 Apr 11 16:35:35.578052 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 10/27] 10.222.0.65 () {60 vars in 1157 bytes} [Mon Apr 11 16:35:34 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:35:36.146881 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-fd735511-ddbc-4f9d-8f85-3618183f58c0 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:36.149060 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-fd735511-ddbc-4f9d-8f85-3618183f58c0 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:36.158557 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fd735511-ddbc-4f9d-8f85-3618183f58c0 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:36.159418 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fd735511-ddbc-4f9d-8f85-3618183f58c0 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:36.161888 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fd735511-ddbc-4f9d-8f85-3618183f58c0 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:36.162545 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fd735511-ddbc-4f9d-8f85-3618183f58c0 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:36.233526 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c1e1caa0-de96-4a74-ab96-967607f1b0f1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:36.252006 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c1e1caa0-de96-4a74-ab96-967607f1b0f1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1282 microversion: 2.1 time: 1.017534 Apr 11 16:35:36.255026 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 18/28] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:35 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1282 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:36.662912 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-fd735511-ddbc-4f9d-8f85-3618183f58c0 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:36.672127 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-fd735511-ddbc-4f9d-8f85-3618183f58c0 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.530252 Apr 11 16:35:36.679883 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 11/29] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:36 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:35:37.270336 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-5b671b95-cbd9-4c4c-9f5b-20a8740403da tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:37.271873 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-5b671b95-cbd9-4c4c-9f5b-20a8740403da tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:37.279215 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5b671b95-cbd9-4c4c-9f5b-20a8740403da tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:37.280424 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5b671b95-cbd9-4c4c-9f5b-20a8740403da tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:37.281331 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5b671b95-cbd9-4c4c-9f5b-20a8740403da tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:37.281853 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5b671b95-cbd9-4c4c-9f5b-20a8740403da tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:37.381959 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5b671b95-cbd9-4c4c-9f5b-20a8740403da tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:37.400585 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-5b671b95-cbd9-4c4c-9f5b-20a8740403da tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1282 microversion: 2.1 time: 0.133798 Apr 11 16:35:37.401808 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 19/30] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:37 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1282 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:37.696494 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e4a07667-abb3-421a-ab4d-f52a7c430794 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:37.697178 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e4a07667-abb3-421a-ab4d-f52a7c430794 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:37.703800 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e4a07667-abb3-421a-ab4d-f52a7c430794 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:37.707867 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e4a07667-abb3-421a-ab4d-f52a7c430794 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:37.708784 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e4a07667-abb3-421a-ab4d-f52a7c430794 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:37.709228 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e4a07667-abb3-421a-ab4d-f52a7c430794 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:37.933875 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e4a07667-abb3-421a-ab4d-f52a7c430794 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:37.950913 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e4a07667-abb3-421a-ab4d-f52a7c430794 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.257231 Apr 11 16:35:37.952392 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 12/31] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:37 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:38.235907 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-e9bf31b0-57b7-45f5-a7a3-1974b7c2b8bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1308920821", "imageRef": "e989c938-7b7a-445c-aec9-596e81d35104", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4bfaa63-8897-444c-b3cb-093694071bc5"}], "security_groups": [{"name": "tempest-securitygroup--246950650"}], "key_name": "tempest-keypair-99754670", "user_data": "}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:35:38.322137 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ba72a04d-909f-4f2d-9593-4c8bdd9bb942 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1155816553", "imageRef": "e989c938-7b7a-445c-aec9-596e81d35104", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "40c7b6b2-a83c-4541-b8fe-c25169cdbc7e"}], "security_groups": [{"name": "tempest-securitygroup--516126836"}], "key_name": "tempest-keypair-1654807370", "user_data": "}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:35:38.443522 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.network.neutron [None req-e9bf31b0-57b7-45f5-a7a3-1974b7c2b8bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] validate_networks() for [('f4bfaa63-8897-444c-b3cb-093694071bc5', None, None, None, None, None)] {{(pid=123773) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:35:38.585169 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.network.neutron [None req-ba72a04d-909f-4f2d-9593-4c8bdd9bb942 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] validate_networks() for [('40c7b6b2-a83c-4541-b8fe-c25169cdbc7e', None, None, None, None, None)] {{(pid=123774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:35:39.478158 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-e9bf31b0-57b7-45f5-a7a3-1974b7c2b8bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Flavor limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:35:39.478158 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-e9bf31b0-57b7-45f5-a7a3-1974b7c2b8bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Image limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:35:39.478759 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-e9bf31b0-57b7-45f5-a7a3-1974b7c2b8bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Flavor pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:35:39.479113 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-e9bf31b0-57b7-45f5-a7a3-1974b7c2b8bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Image pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:35:39.479589 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-e9bf31b0-57b7-45f5-a7a3-1974b7c2b8bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:35:39.489445 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e9bf31b0-57b7-45f5-a7a3-1974b7c2b8bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:39.490002 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e9bf31b0-57b7-45f5-a7a3-1974b7c2b8bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:39.490907 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e9bf31b0-57b7-45f5-a7a3-1974b7c2b8bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:39.491462 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e9bf31b0-57b7-45f5-a7a3-1974b7c2b8bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:39.513697 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-e9bf31b0-57b7-45f5-a7a3-1974b7c2b8bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Getting quotas for project fff5d5c8db254085a82ca911ead15f49. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:35:39.518253 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-e9bf31b0-57b7-45f5-a7a3-1974b7c2b8bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Getting quotas for user 98902ced574b44779b9aec59a2f999fb and project fff5d5c8db254085a82ca911ead15f49. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:35:39.531389 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-e9bf31b0-57b7-45f5-a7a3-1974b7c2b8bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Going to run 1 instances... {{(pid=123773) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:35:39.533892 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-e9bf31b0-57b7-45f5-a7a3-1974b7c2b8bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e989c938-7b7a-445c-aec9-596e81d35104',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:35:39.543932 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-ba72a04d-909f-4f2d-9593-4c8bdd9bb942 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Flavor limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:35:39.544951 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-ba72a04d-909f-4f2d-9593-4c8bdd9bb942 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Image limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:35:39.545601 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-ba72a04d-909f-4f2d-9593-4c8bdd9bb942 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Flavor pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:35:39.546195 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-ba72a04d-909f-4f2d-9593-4c8bdd9bb942 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Image pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:35:39.546808 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-ba72a04d-909f-4f2d-9593-4c8bdd9bb942 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:35:39.556020 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ba72a04d-909f-4f2d-9593-4c8bdd9bb942 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:39.556531 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ba72a04d-909f-4f2d-9593-4c8bdd9bb942 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:39.557499 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ba72a04d-909f-4f2d-9593-4c8bdd9bb942 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:39.558064 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ba72a04d-909f-4f2d-9593-4c8bdd9bb942 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:39.581340 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-ba72a04d-909f-4f2d-9593-4c8bdd9bb942 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Getting quotas for project 90215ff8d2af4f1fa9d0137fcb2f881d. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:35:39.586385 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-ba72a04d-909f-4f2d-9593-4c8bdd9bb942 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Getting quotas for user d94b4c03d94440e7b92ea1051cb3625e and project 90215ff8d2af4f1fa9d0137fcb2f881d. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:35:39.599789 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ba72a04d-909f-4f2d-9593-4c8bdd9bb942 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Going to run 1 instances... {{(pid=123774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:35:39.602356 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-e9bf31b0-57b7-45f5-a7a3-1974b7c2b8bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.370814 Apr 11 16:35:39.603200 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ba72a04d-909f-4f2d-9593-4c8bdd9bb942 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e989c938-7b7a-445c-aec9-596e81d35104',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:35:39.603835 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 20/32] 10.222.0.65 () {62 vars in 1187 bytes} [Mon Apr 11 16:35:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1373 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 11 16:35:39.610384 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-48ee32be-7488-447f-ba57-ea2c6e0bb239 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:39.611436 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-48ee32be-7488-447f-ba57-ea2c6e0bb239 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:39.619196 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-48ee32be-7488-447f-ba57-ea2c6e0bb239 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:39.620323 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-48ee32be-7488-447f-ba57-ea2c6e0bb239 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:39.621432 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-48ee32be-7488-447f-ba57-ea2c6e0bb239 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:39.622086 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-48ee32be-7488-447f-ba57-ea2c6e0bb239 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:39.697870 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ba72a04d-909f-4f2d-9593-4c8bdd9bb942 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.379487 Apr 11 16:35:39.698876 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 13/33] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Apr 11 16:35:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 11 16:35:39.713125 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-48ee32be-7488-447f-ba57-ea2c6e0bb239 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:39.715061 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-103e84a3-c48f-4491-a90e-82b719dc6549 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:39.716269 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-103e84a3-c48f-4491-a90e-82b719dc6549 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:39.723941 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-103e84a3-c48f-4491-a90e-82b719dc6549 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:39.725306 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-103e84a3-c48f-4491-a90e-82b719dc6549 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:39.727198 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-103e84a3-c48f-4491-a90e-82b719dc6549 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:39.728014 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-103e84a3-c48f-4491-a90e-82b719dc6549 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:39.734558 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-48ee32be-7488-447f-ba57-ea2c6e0bb239 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1292 microversion: 2.1 time: 0.126042 Apr 11 16:35:39.737413 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 21/34] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:39 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1292 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:39.903329 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-1347e0aa-f1b8-4f4c-b854-4cb7fee70a4a req-cf487f01-3c61-4f38-849f-c99a6372d39e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3dc4a3c-61a6-4e27-af48-37b52aa6a959", "tag": "dda955e6-e188-4b67-ae24-2bcd2bd689f7"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:35:39.932982 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-1347e0aa-f1b8-4f4c-b854-4cb7fee70a4a req-cf487f01-3c61-4f38-849f-c99a6372d39e service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:39.933805 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-1347e0aa-f1b8-4f4c-b854-4cb7fee70a4a req-cf487f01-3c61-4f38-849f-c99a6372d39e service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:39.977852 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-1347e0aa-f1b8-4f4c-b854-4cb7fee70a4a req-cf487f01-3c61-4f38-849f-c99a6372d39e service nova] Creating event network-changed:dda955e6-e188-4b67-ae24-2bcd2bd689f7 for instance a3dc4a3c-61a6-4e27-af48-37b52aa6a959 on hv-cinder-83716 Apr 11 16:35:39.978518 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-1347e0aa-f1b8-4f4c-b854-4cb7fee70a4a req-cf487f01-3c61-4f38-849f-c99a6372d39e service nova] Acquired lock "compute-rpcapi-router" {{(pid=123773) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 11 16:35:39.979749 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6cb311e-bd6b-4609-bb4d-1bf9080f0811 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:39.983416 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6cb311e-bd6b-4609-bb4d-1bf9080f0811 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:39.986606 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6cb311e-bd6b-4609-bb4d-1bf9080f0811 None None] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:39.987207 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6cb311e-bd6b-4609-bb4d-1bf9080f0811 None None] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:40.008553 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.compute.rpcapi [None req-b6cb311e-bd6b-4609-bb4d-1bf9080f0811 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 11 16:35:40.009455 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6cb311e-bd6b-4609-bb4d-1bf9080f0811 None None] Releasing lock "compute-rpcapi-router" {{(pid=123773) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 16:35:40.034196 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-103e84a3-c48f-4491-a90e-82b719dc6549 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:40.049849 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-103e84a3-c48f-4491-a90e-82b719dc6549 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.349530 Apr 11 16:35:40.050479 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 14/35] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:39 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:40.058574 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b6cb311e-bd6b-4609-bb4d-1bf9080f0811 None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.319598 Apr 11 16:35:40.059192 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 22/36] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:35:40.067079 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-72d9f647-9856-4b7a-85cf-46a13ad42ed7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:40.067831 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e1e10ad8-6653-4532-8897-a6a262ffb959 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:40.068447 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e1e10ad8-6653-4532-8897-a6a262ffb959 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:40.071148 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-72d9f647-9856-4b7a-85cf-46a13ad42ed7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:40.243939 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-72d9f647-9856-4b7a-85cf-46a13ad42ed7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:40.256439 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-72d9f647-9856-4b7a-85cf-46a13ad42ed7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1238 microversion: 2.1 time: 0.195179 Apr 11 16:35:40.274702 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 23/37] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:40 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1238 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:40.280634 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e1e10ad8-6653-4532-8897-a6a262ffb959 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:40.304660 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e1e10ad8-6653-4532-8897-a6a262ffb959 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:40.306665 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e1e10ad8-6653-4532-8897-a6a262ffb959 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:40.307861 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e1e10ad8-6653-4532-8897-a6a262ffb959 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1280 microversion: 2.20 time: 0.255845 Apr 11 16:35:40.308436 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 15/38] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:35:40 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1280 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:35:40.753929 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-dcc749a3-9dee-4901-bc2f-04718e352715 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:40.754553 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-dcc749a3-9dee-4901-bc2f-04718e352715 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:40.761500 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dcc749a3-9dee-4901-bc2f-04718e352715 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:40.762147 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dcc749a3-9dee-4901-bc2f-04718e352715 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:40.763106 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dcc749a3-9dee-4901-bc2f-04718e352715 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:40.763543 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dcc749a3-9dee-4901-bc2f-04718e352715 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:40.844867 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-dcc749a3-9dee-4901-bc2f-04718e352715 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:40.854383 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-dcc749a3-9dee-4901-bc2f-04718e352715 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1292 microversion: 2.1 time: 0.104433 Apr 11 16:35:40.854990 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 24/39] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:40 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1292 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:41.068310 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-9f4d2716-48c4-4352-bfa2-1d65e201ddb4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:41.069545 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-9f4d2716-48c4-4352-bfa2-1d65e201ddb4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:41.076062 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9f4d2716-48c4-4352-bfa2-1d65e201ddb4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:41.076503 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9f4d2716-48c4-4352-bfa2-1d65e201ddb4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:41.077270 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9f4d2716-48c4-4352-bfa2-1d65e201ddb4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:41.077694 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9f4d2716-48c4-4352-bfa2-1d65e201ddb4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:41.224227 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-9f4d2716-48c4-4352-bfa2-1d65e201ddb4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:41.238299 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-9f4d2716-48c4-4352-bfa2-1d65e201ddb4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.174225 Apr 11 16:35:41.250911 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 16/40] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:41 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:41.286069 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-a30a7b40-b687-41a9-a3c1-927187636a4b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:41.286996 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-a30a7b40-b687-41a9-a3c1-927187636a4b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:41.303060 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a30a7b40-b687-41a9-a3c1-927187636a4b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:41.303591 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a30a7b40-b687-41a9-a3c1-927187636a4b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:41.304534 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a30a7b40-b687-41a9-a3c1-927187636a4b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:41.305040 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a30a7b40-b687-41a9-a3c1-927187636a4b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:41.327313 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-493e8500-6a7c-4667-849e-278f6dd55531 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:41.328432 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-493e8500-6a7c-4667-849e-278f6dd55531 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:41.346731 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-493e8500-6a7c-4667-849e-278f6dd55531 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:41.347245 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-493e8500-6a7c-4667-849e-278f6dd55531 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:41.351793 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-493e8500-6a7c-4667-849e-278f6dd55531 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:41.352408 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-493e8500-6a7c-4667-849e-278f6dd55531 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:41.416696 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-a30a7b40-b687-41a9-a3c1-927187636a4b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:41.430825 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-a30a7b40-b687-41a9-a3c1-927187636a4b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1242 microversion: 2.1 time: 0.152117 Apr 11 16:35:41.431867 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 25/41] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:41 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1242 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:41.453366 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-493e8500-6a7c-4667-849e-278f6dd55531 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:41.467557 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-493e8500-6a7c-4667-849e-278f6dd55531 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:41.470120 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-493e8500-6a7c-4667-849e-278f6dd55531 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:41.472658 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-493e8500-6a7c-4667-849e-278f6dd55531 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1284 microversion: 2.20 time: 0.150638 Apr 11 16:35:41.483582 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 17/42] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:35:41 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:35:41.872160 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3fd9d1d2-ad74-498e-93ae-61c94b1b23cc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:41.873666 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3fd9d1d2-ad74-498e-93ae-61c94b1b23cc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:41.887073 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3fd9d1d2-ad74-498e-93ae-61c94b1b23cc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:41.887934 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3fd9d1d2-ad74-498e-93ae-61c94b1b23cc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:41.889064 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3fd9d1d2-ad74-498e-93ae-61c94b1b23cc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:41.890815 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3fd9d1d2-ad74-498e-93ae-61c94b1b23cc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:42.028099 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3fd9d1d2-ad74-498e-93ae-61c94b1b23cc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:42.045688 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3fd9d1d2-ad74-498e-93ae-61c94b1b23cc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1292 microversion: 2.1 time: 0.175952 Apr 11 16:35:42.046340 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 26/43] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:41 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1292 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:42.258394 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5e04c066-ffc3-40f7-b497-989da6a31ff6 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:42.259936 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5e04c066-ffc3-40f7-b497-989da6a31ff6 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:42.268339 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5e04c066-ffc3-40f7-b497-989da6a31ff6 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:42.269043 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5e04c066-ffc3-40f7-b497-989da6a31ff6 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:42.269813 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5e04c066-ffc3-40f7-b497-989da6a31ff6 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:42.270244 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5e04c066-ffc3-40f7-b497-989da6a31ff6 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:42.423240 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5e04c066-ffc3-40f7-b497-989da6a31ff6 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:42.431807 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5e04c066-ffc3-40f7-b497-989da6a31ff6 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.177897 Apr 11 16:35:42.432744 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 18/44] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:42 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:42.451334 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1dd537ef-7896-4d9a-8d16-9cb2d5bd5f27 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:42.472155 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1dd537ef-7896-4d9a-8d16-9cb2d5bd5f27 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:42.479909 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1dd537ef-7896-4d9a-8d16-9cb2d5bd5f27 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:42.480662 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1dd537ef-7896-4d9a-8d16-9cb2d5bd5f27 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:42.482429 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1dd537ef-7896-4d9a-8d16-9cb2d5bd5f27 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:42.485202 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1dd537ef-7896-4d9a-8d16-9cb2d5bd5f27 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:42.492764 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f472ed38-7dc6-4032-a537-8813cb37e825 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:42.493374 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f472ed38-7dc6-4032-a537-8813cb37e825 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:42.499523 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f472ed38-7dc6-4032-a537-8813cb37e825 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:42.500991 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f472ed38-7dc6-4032-a537-8813cb37e825 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:42.502114 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f472ed38-7dc6-4032-a537-8813cb37e825 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:42.502732 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f472ed38-7dc6-4032-a537-8813cb37e825 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:42.559572 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1dd537ef-7896-4d9a-8d16-9cb2d5bd5f27 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:42.570214 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1dd537ef-7896-4d9a-8d16-9cb2d5bd5f27 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1242 microversion: 2.1 time: 0.122525 Apr 11 16:35:42.571355 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 27/45] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:42 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1242 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:42.596529 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f472ed38-7dc6-4032-a537-8813cb37e825 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:42.605549 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f472ed38-7dc6-4032-a537-8813cb37e825 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:42.608262 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f472ed38-7dc6-4032-a537-8813cb37e825 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:42.609614 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f472ed38-7dc6-4032-a537-8813cb37e825 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1284 microversion: 2.20 time: 0.123086 Apr 11 16:35:42.610789 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 19/46] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:35:42 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:35:43.063401 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3d5b8af2-8745-4b0a-a5d4-c80011458039 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:43.064900 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3d5b8af2-8745-4b0a-a5d4-c80011458039 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:43.074875 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3d5b8af2-8745-4b0a-a5d4-c80011458039 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:43.075497 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3d5b8af2-8745-4b0a-a5d4-c80011458039 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:43.077158 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3d5b8af2-8745-4b0a-a5d4-c80011458039 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:43.077776 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3d5b8af2-8745-4b0a-a5d4-c80011458039 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:43.186063 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3d5b8af2-8745-4b0a-a5d4-c80011458039 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:43.200076 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3d5b8af2-8745-4b0a-a5d4-c80011458039 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1292 microversion: 2.1 time: 0.140721 Apr 11 16:35:43.200878 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 28/47] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:43 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1292 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:35:43.450982 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-bdfea2c8-45ec-491b-8797-a45f62006e42 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:43.451586 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-bdfea2c8-45ec-491b-8797-a45f62006e42 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:43.469075 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bdfea2c8-45ec-491b-8797-a45f62006e42 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:43.472431 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bdfea2c8-45ec-491b-8797-a45f62006e42 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:43.473289 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bdfea2c8-45ec-491b-8797-a45f62006e42 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:43.473894 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bdfea2c8-45ec-491b-8797-a45f62006e42 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:43.598559 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ea65f729-c8af-4a78-8f77-bfdf445ceda7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:43.599259 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ea65f729-c8af-4a78-8f77-bfdf445ceda7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:43.617595 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ea65f729-c8af-4a78-8f77-bfdf445ceda7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:43.618278 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ea65f729-c8af-4a78-8f77-bfdf445ceda7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:43.619839 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ea65f729-c8af-4a78-8f77-bfdf445ceda7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:43.620432 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ea65f729-c8af-4a78-8f77-bfdf445ceda7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:43.688340 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-bdfea2c8-45ec-491b-8797-a45f62006e42 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:43.696394 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-bdfea2c8-45ec-491b-8797-a45f62006e42 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.249821 Apr 11 16:35:43.699778 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 20/48] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:43 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:43.706551 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-9ea6034d-44bd-4a1f-aef0-42105666c291 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:43.708293 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-9ea6034d-44bd-4a1f-aef0-42105666c291 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:43.719177 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9ea6034d-44bd-4a1f-aef0-42105666c291 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:43.720475 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9ea6034d-44bd-4a1f-aef0-42105666c291 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:43.722106 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9ea6034d-44bd-4a1f-aef0-42105666c291 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:43.723421 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9ea6034d-44bd-4a1f-aef0-42105666c291 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:43.725576 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ea65f729-c8af-4a78-8f77-bfdf445ceda7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:43.734605 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ea65f729-c8af-4a78-8f77-bfdf445ceda7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1242 microversion: 2.1 time: 0.147776 Apr 11 16:35:43.738527 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 29/49] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:43 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1242 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:43.794420 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-9ea6034d-44bd-4a1f-aef0-42105666c291 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:43.802290 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-9ea6034d-44bd-4a1f-aef0-42105666c291 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:43.803933 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-9ea6034d-44bd-4a1f-aef0-42105666c291 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:43.805021 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-9ea6034d-44bd-4a1f-aef0-42105666c291 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1284 microversion: 2.20 time: 0.102405 Apr 11 16:35:43.805593 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 21/50] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:35:43 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:35:44.217922 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d5a40670-e6ca-4f45-9f67-daf93c2487b2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:44.218476 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d5a40670-e6ca-4f45-9f67-daf93c2487b2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:44.224679 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d5a40670-e6ca-4f45-9f67-daf93c2487b2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:44.225123 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d5a40670-e6ca-4f45-9f67-daf93c2487b2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:44.225989 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d5a40670-e6ca-4f45-9f67-daf93c2487b2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:44.226476 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d5a40670-e6ca-4f45-9f67-daf93c2487b2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:44.288187 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d5a40670-e6ca-4f45-9f67-daf93c2487b2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:44.296484 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d5a40670-e6ca-4f45-9f67-daf93c2487b2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1292 microversion: 2.1 time: 0.082548 Apr 11 16:35:44.297103 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 30/51] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:44 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:44.716247 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-df3f2e77-aca2-4ef1-b381-2e66d60b12cb tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:44.716998 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-df3f2e77-aca2-4ef1-b381-2e66d60b12cb tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:44.723812 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-df3f2e77-aca2-4ef1-b381-2e66d60b12cb tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:44.724249 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-df3f2e77-aca2-4ef1-b381-2e66d60b12cb tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:44.725039 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-df3f2e77-aca2-4ef1-b381-2e66d60b12cb tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:44.725486 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-df3f2e77-aca2-4ef1-b381-2e66d60b12cb tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:44.753551 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-83842544-4371-4a6b-bb38-356f586b4fc4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:44.754505 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-83842544-4371-4a6b-bb38-356f586b4fc4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:44.761902 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-83842544-4371-4a6b-bb38-356f586b4fc4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:44.762644 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-83842544-4371-4a6b-bb38-356f586b4fc4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:44.763422 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-83842544-4371-4a6b-bb38-356f586b4fc4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:44.763884 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-83842544-4371-4a6b-bb38-356f586b4fc4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:44.833018 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-83842544-4371-4a6b-bb38-356f586b4fc4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:44.842361 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-83842544-4371-4a6b-bb38-356f586b4fc4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1242 microversion: 2.1 time: 0.092947 Apr 11 16:35:44.843372 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 31/52] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:44 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:35:44.848415 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-35f93de3-1ab7-4800-b72f-e0174fb5bd87 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:44.849113 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-35f93de3-1ab7-4800-b72f-e0174fb5bd87 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:44.855393 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-35f93de3-1ab7-4800-b72f-e0174fb5bd87 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:44.855955 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-35f93de3-1ab7-4800-b72f-e0174fb5bd87 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:44.856820 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-35f93de3-1ab7-4800-b72f-e0174fb5bd87 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:44.857329 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-35f93de3-1ab7-4800-b72f-e0174fb5bd87 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:44.894624 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-df3f2e77-aca2-4ef1-b381-2e66d60b12cb tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:44.902332 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-df3f2e77-aca2-4ef1-b381-2e66d60b12cb tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.190219 Apr 11 16:35:44.903234 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 22/53] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:44 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:44.920962 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-35f93de3-1ab7-4800-b72f-e0174fb5bd87 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:44.929035 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-35f93de3-1ab7-4800-b72f-e0174fb5bd87 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:44.930550 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-35f93de3-1ab7-4800-b72f-e0174fb5bd87 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:44.931673 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-35f93de3-1ab7-4800-b72f-e0174fb5bd87 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1284 microversion: 2.20 time: 0.087253 Apr 11 16:35:44.932277 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 32/54] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:35:44 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:35:45.313404 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-3e1a22f1-bb5f-4f4e-98f7-d0b4f6112aa8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:45.314062 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-3e1a22f1-bb5f-4f4e-98f7-d0b4f6112aa8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:45.320696 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3e1a22f1-bb5f-4f4e-98f7-d0b4f6112aa8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:45.321141 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3e1a22f1-bb5f-4f4e-98f7-d0b4f6112aa8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:45.321910 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3e1a22f1-bb5f-4f4e-98f7-d0b4f6112aa8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:45.322336 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3e1a22f1-bb5f-4f4e-98f7-d0b4f6112aa8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:45.384844 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-3e1a22f1-bb5f-4f4e-98f7-d0b4f6112aa8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:45.396444 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-3e1a22f1-bb5f-4f4e-98f7-d0b4f6112aa8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1292 microversion: 2.1 time: 0.085291 Apr 11 16:35:45.397262 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 23/55] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:45 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:45.860697 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-8bc07dab-a85d-4b9e-a363-197369b74962 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:45.861302 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-8bc07dab-a85d-4b9e-a363-197369b74962 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:45.868256 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8bc07dab-a85d-4b9e-a363-197369b74962 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:45.868710 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8bc07dab-a85d-4b9e-a363-197369b74962 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:45.869502 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8bc07dab-a85d-4b9e-a363-197369b74962 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:45.869938 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8bc07dab-a85d-4b9e-a363-197369b74962 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:45.919995 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-43b3cfd1-93e0-41a3-a088-a64ae90ec1f5 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:45.921182 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-43b3cfd1-93e0-41a3-a088-a64ae90ec1f5 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:45.929223 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-43b3cfd1-93e0-41a3-a088-a64ae90ec1f5 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:45.929766 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-43b3cfd1-93e0-41a3-a088-a64ae90ec1f5 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:45.930712 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-43b3cfd1-93e0-41a3-a088-a64ae90ec1f5 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:45.931146 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-43b3cfd1-93e0-41a3-a088-a64ae90ec1f5 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:45.944953 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-8bc07dab-a85d-4b9e-a363-197369b74962 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:45.958528 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-8bc07dab-a85d-4b9e-a363-197369b74962 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1242 microversion: 2.1 time: 0.102093 Apr 11 16:35:45.962816 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 33/56] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:45 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1242 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:45.965639 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c4004874-0585-4327-b89e-64fe8390b0f7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:45.966243 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c4004874-0585-4327-b89e-64fe8390b0f7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:45.972575 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c4004874-0585-4327-b89e-64fe8390b0f7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:45.973060 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c4004874-0585-4327-b89e-64fe8390b0f7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:45.973826 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c4004874-0585-4327-b89e-64fe8390b0f7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:45.974253 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c4004874-0585-4327-b89e-64fe8390b0f7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:46.056307 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c4004874-0585-4327-b89e-64fe8390b0f7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:46.066230 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c4004874-0585-4327-b89e-64fe8390b0f7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:46.068286 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c4004874-0585-4327-b89e-64fe8390b0f7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:46.071615 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c4004874-0585-4327-b89e-64fe8390b0f7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1284 microversion: 2.20 time: 0.110575 Apr 11 16:35:46.072666 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 34/57] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:35:45 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:35:46.105801 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-43b3cfd1-93e0-41a3-a088-a64ae90ec1f5 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:46.114243 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-43b3cfd1-93e0-41a3-a088-a64ae90ec1f5 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.198180 Apr 11 16:35:46.114763 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 24/58] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:45 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:35:46.412518 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-973d3fe5-1a5f-428c-8d7c-b272e9b9f22c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:46.413039 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-973d3fe5-1a5f-428c-8d7c-b272e9b9f22c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:46.419482 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-973d3fe5-1a5f-428c-8d7c-b272e9b9f22c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:46.419962 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-973d3fe5-1a5f-428c-8d7c-b272e9b9f22c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:46.420737 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-973d3fe5-1a5f-428c-8d7c-b272e9b9f22c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:46.421162 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-973d3fe5-1a5f-428c-8d7c-b272e9b9f22c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:46.482727 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-973d3fe5-1a5f-428c-8d7c-b272e9b9f22c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:46.490803 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-973d3fe5-1a5f-428c-8d7c-b272e9b9f22c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1292 microversion: 2.1 time: 0.082388 Apr 11 16:35:46.491482 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 35/59] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:46 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:46.977213 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-8a397d3c-8316-4357-ad5e-53770c89c439 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:46.977911 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-8a397d3c-8316-4357-ad5e-53770c89c439 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:46.984842 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8a397d3c-8316-4357-ad5e-53770c89c439 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:46.985606 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8a397d3c-8316-4357-ad5e-53770c89c439 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:46.986976 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8a397d3c-8316-4357-ad5e-53770c89c439 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:46.987585 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8a397d3c-8316-4357-ad5e-53770c89c439 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:47.056986 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8a397d3c-8316-4357-ad5e-53770c89c439 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:47.067927 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-8a397d3c-8316-4357-ad5e-53770c89c439 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1242 microversion: 2.1 time: 0.094663 Apr 11 16:35:47.068504 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 25/60] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:46 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1242 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:47.090693 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-eda5fc4d-c077-470f-b714-4160fcf9b195 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:47.091344 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-eda5fc4d-c077-470f-b714-4160fcf9b195 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:47.097888 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-eda5fc4d-c077-470f-b714-4160fcf9b195 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:47.098399 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-eda5fc4d-c077-470f-b714-4160fcf9b195 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:47.099261 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-eda5fc4d-c077-470f-b714-4160fcf9b195 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:47.100011 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-eda5fc4d-c077-470f-b714-4160fcf9b195 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:47.132513 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-dea5fd61-a6ae-47cc-87b8-d56409562ff9 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:47.133398 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-dea5fd61-a6ae-47cc-87b8-d56409562ff9 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:47.139947 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dea5fd61-a6ae-47cc-87b8-d56409562ff9 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:47.140416 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dea5fd61-a6ae-47cc-87b8-d56409562ff9 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:47.141214 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dea5fd61-a6ae-47cc-87b8-d56409562ff9 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:47.141770 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dea5fd61-a6ae-47cc-87b8-d56409562ff9 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:47.165428 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-eda5fc4d-c077-470f-b714-4160fcf9b195 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:47.174018 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-eda5fc4d-c077-470f-b714-4160fcf9b195 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:47.175705 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-eda5fc4d-c077-470f-b714-4160fcf9b195 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:47.176860 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-eda5fc4d-c077-470f-b714-4160fcf9b195 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1284 microversion: 2.20 time: 0.090543 Apr 11 16:35:47.177424 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 36/61] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:35:47 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:35:47.276388 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-dea5fd61-a6ae-47cc-87b8-d56409562ff9 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:47.284068 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-dea5fd61-a6ae-47cc-87b8-d56409562ff9 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.155966 Apr 11 16:35:47.284649 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 26/62] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:47 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:35:47.508489 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-a21a7545-511e-4755-b962-549e8b4fc57c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:47.509067 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-a21a7545-511e-4755-b962-549e8b4fc57c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:47.515741 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a21a7545-511e-4755-b962-549e8b4fc57c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:47.516186 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a21a7545-511e-4755-b962-549e8b4fc57c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:47.516943 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a21a7545-511e-4755-b962-549e8b4fc57c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:47.517364 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a21a7545-511e-4755-b962-549e8b4fc57c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:47.578903 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-a21a7545-511e-4755-b962-549e8b4fc57c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:47.587426 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-a21a7545-511e-4755-b962-549e8b4fc57c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1292 microversion: 2.1 time: 0.083274 Apr 11 16:35:47.588282 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 37/63] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:47 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:48.084968 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-b37769c6-c961-4adf-a24e-1f6b1707ac13 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:48.085573 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-b37769c6-c961-4adf-a24e-1f6b1707ac13 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:48.092193 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b37769c6-c961-4adf-a24e-1f6b1707ac13 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:48.092662 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b37769c6-c961-4adf-a24e-1f6b1707ac13 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:48.093436 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b37769c6-c961-4adf-a24e-1f6b1707ac13 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:48.093863 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b37769c6-c961-4adf-a24e-1f6b1707ac13 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:48.157079 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-b37769c6-c961-4adf-a24e-1f6b1707ac13 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:48.164791 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-b37769c6-c961-4adf-a24e-1f6b1707ac13 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1242 microversion: 2.1 time: 0.083752 Apr 11 16:35:48.165389 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 27/64] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:48 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:48.194815 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-119a4e68-8c9c-40f6-8347-a49deb5cd778 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:48.195398 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-119a4e68-8c9c-40f6-8347-a49deb5cd778 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:48.201707 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-119a4e68-8c9c-40f6-8347-a49deb5cd778 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:48.202160 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-119a4e68-8c9c-40f6-8347-a49deb5cd778 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:48.202921 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-119a4e68-8c9c-40f6-8347-a49deb5cd778 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:48.203361 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-119a4e68-8c9c-40f6-8347-a49deb5cd778 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:48.263851 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-119a4e68-8c9c-40f6-8347-a49deb5cd778 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:48.272287 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-119a4e68-8c9c-40f6-8347-a49deb5cd778 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:48.273946 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-119a4e68-8c9c-40f6-8347-a49deb5cd778 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:48.275048 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-119a4e68-8c9c-40f6-8347-a49deb5cd778 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1284 microversion: 2.20 time: 0.084499 Apr 11 16:35:48.275628 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 38/65] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:35:48 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:35:48.300553 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-2c4cd4e8-3e28-4312-90ef-247bce76bfbd tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:48.301192 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-2c4cd4e8-3e28-4312-90ef-247bce76bfbd tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:48.307967 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2c4cd4e8-3e28-4312-90ef-247bce76bfbd tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:48.308414 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2c4cd4e8-3e28-4312-90ef-247bce76bfbd tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:48.309184 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2c4cd4e8-3e28-4312-90ef-247bce76bfbd tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:48.309611 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2c4cd4e8-3e28-4312-90ef-247bce76bfbd tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:48.445123 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-2c4cd4e8-3e28-4312-90ef-247bce76bfbd tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:48.453592 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-2c4cd4e8-3e28-4312-90ef-247bce76bfbd tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.156775 Apr 11 16:35:48.454259 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 28/66] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:48 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:48.605131 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c72ea1d6-5894-4f17-8e74-639072f6a9ea tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:48.605776 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c72ea1d6-5894-4f17-8e74-639072f6a9ea tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:48.612330 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c72ea1d6-5894-4f17-8e74-639072f6a9ea tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:48.612773 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c72ea1d6-5894-4f17-8e74-639072f6a9ea tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:48.613510 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c72ea1d6-5894-4f17-8e74-639072f6a9ea tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:48.613965 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c72ea1d6-5894-4f17-8e74-639072f6a9ea tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:48.677493 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c72ea1d6-5894-4f17-8e74-639072f6a9ea tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:48.685452 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c72ea1d6-5894-4f17-8e74-639072f6a9ea tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1292 microversion: 2.1 time: 0.084592 Apr 11 16:35:48.686026 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 39/67] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:48 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:49.183108 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-2a7e4ffa-4aa9-476a-b190-2d83f14acbb3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:49.184699 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-2a7e4ffa-4aa9-476a-b190-2d83f14acbb3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:49.191087 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2a7e4ffa-4aa9-476a-b190-2d83f14acbb3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:49.191741 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2a7e4ffa-4aa9-476a-b190-2d83f14acbb3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:49.192505 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2a7e4ffa-4aa9-476a-b190-2d83f14acbb3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:49.192927 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2a7e4ffa-4aa9-476a-b190-2d83f14acbb3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:49.266426 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-2a7e4ffa-4aa9-476a-b190-2d83f14acbb3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:49.274807 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-2a7e4ffa-4aa9-476a-b190-2d83f14acbb3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1242 microversion: 2.1 time: 0.096551 Apr 11 16:35:49.275514 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 29/68] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:49 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:49.293342 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-bbea02fc-a951-4aef-9e1f-1d2945fde6c7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:49.294014 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-bbea02fc-a951-4aef-9e1f-1d2945fde6c7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:49.300804 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bbea02fc-a951-4aef-9e1f-1d2945fde6c7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:49.301240 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bbea02fc-a951-4aef-9e1f-1d2945fde6c7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:49.301996 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bbea02fc-a951-4aef-9e1f-1d2945fde6c7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:49.302494 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bbea02fc-a951-4aef-9e1f-1d2945fde6c7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:49.396431 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-bbea02fc-a951-4aef-9e1f-1d2945fde6c7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:49.411249 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-bbea02fc-a951-4aef-9e1f-1d2945fde6c7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:49.415206 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-bbea02fc-a951-4aef-9e1f-1d2945fde6c7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:49.418504 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-bbea02fc-a951-4aef-9e1f-1d2945fde6c7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1284 microversion: 2.20 time: 0.129371 Apr 11 16:35:49.437436 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 40/69] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:35:49 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:35:49.476249 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-3e4835f9-87c6-43fc-88ac-e872bbf34db5 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:49.479813 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-3e4835f9-87c6-43fc-88ac-e872bbf34db5 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:49.510194 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3e4835f9-87c6-43fc-88ac-e872bbf34db5 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:49.510642 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3e4835f9-87c6-43fc-88ac-e872bbf34db5 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:49.512964 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3e4835f9-87c6-43fc-88ac-e872bbf34db5 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:49.514099 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3e4835f9-87c6-43fc-88ac-e872bbf34db5 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:49.701766 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-4b2d9481-a723-4c69-a9e1-43ad2c79635b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:49.702559 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-4b2d9481-a723-4c69-a9e1-43ad2c79635b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:49.721607 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4b2d9481-a723-4c69-a9e1-43ad2c79635b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:49.730957 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4b2d9481-a723-4c69-a9e1-43ad2c79635b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:49.734878 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4b2d9481-a723-4c69-a9e1-43ad2c79635b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:49.735695 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4b2d9481-a723-4c69-a9e1-43ad2c79635b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:49.903512 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-4b2d9481-a723-4c69-a9e1-43ad2c79635b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:49.906526 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-3e4835f9-87c6-43fc-88ac-e872bbf34db5 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:49.910848 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-4b2d9481-a723-4c69-a9e1-43ad2c79635b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1280 microversion: 2.1 time: 0.212986 Apr 11 16:35:49.911497 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 41/70] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:49 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1280 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:35:49.914490 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-3e4835f9-87c6-43fc-88ac-e872bbf34db5 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.447485 Apr 11 16:35:49.924106 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 30/71] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:49 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:50.004179 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-c254c514-8fdf-4495-bd6b-11e8af70143c req-340ed195-bf06-4e1d-a8e2-01f42b63e1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3017c9b9-0056-46a2-b176-6036aad45db0", "tag": "945545f7-d75c-4885-8d14-73d74d4f110d"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:35:50.013223 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-c254c514-8fdf-4495-bd6b-11e8af70143c req-340ed195-bf06-4e1d-a8e2-01f42b63e1c4 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:50.013685 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-c254c514-8fdf-4495-bd6b-11e8af70143c req-340ed195-bf06-4e1d-a8e2-01f42b63e1c4 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:50.025187 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-c254c514-8fdf-4495-bd6b-11e8af70143c req-340ed195-bf06-4e1d-a8e2-01f42b63e1c4 service nova] Creating event network-changed:945545f7-d75c-4885-8d14-73d74d4f110d for instance 3017c9b9-0056-46a2-b176-6036aad45db0 on hv-cinder-83716 Apr 11 16:35:50.030331 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-c254c514-8fdf-4495-bd6b-11e8af70143c req-340ed195-bf06-4e1d-a8e2-01f42b63e1c4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087429 Apr 11 16:35:50.031097 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 42/72] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:35:50.292548 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d8ef2537-2923-4a45-95c6-0921a7083179 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:50.293222 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d8ef2537-2923-4a45-95c6-0921a7083179 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:50.300067 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d8ef2537-2923-4a45-95c6-0921a7083179 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:50.300852 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d8ef2537-2923-4a45-95c6-0921a7083179 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:50.301770 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d8ef2537-2923-4a45-95c6-0921a7083179 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:50.302423 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d8ef2537-2923-4a45-95c6-0921a7083179 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:50.371211 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d8ef2537-2923-4a45-95c6-0921a7083179 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:50.382651 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d8ef2537-2923-4a45-95c6-0921a7083179 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1290 microversion: 2.1 time: 0.094475 Apr 11 16:35:50.383972 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 31/73] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:50 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1290 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:50.451243 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1b1d95d6-1174-4263-ab4d-fff2fc467b16 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:50.451968 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1b1d95d6-1174-4263-ab4d-fff2fc467b16 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:50.458786 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1b1d95d6-1174-4263-ab4d-fff2fc467b16 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:50.459413 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1b1d95d6-1174-4263-ab4d-fff2fc467b16 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:50.460319 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1b1d95d6-1174-4263-ab4d-fff2fc467b16 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:50.460749 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1b1d95d6-1174-4263-ab4d-fff2fc467b16 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:50.644028 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1b1d95d6-1174-4263-ab4d-fff2fc467b16 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:50.658059 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1b1d95d6-1174-4263-ab4d-fff2fc467b16 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:50.660546 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1b1d95d6-1174-4263-ab4d-fff2fc467b16 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:50.662028 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1b1d95d6-1174-4263-ab4d-fff2fc467b16 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1340 microversion: 2.20 time: 0.215243 Apr 11 16:35:50.674654 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 43/74] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:35:50 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1340 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:35:50.931381 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-fc46b15c-eebd-4beb-9dc4-015b101ef05e tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:50.931748 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-8d2ce27c-276e-4333-93c4-c5e933c22a3c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:50.932039 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-fc46b15c-eebd-4beb-9dc4-015b101ef05e tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:50.932977 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-8d2ce27c-276e-4333-93c4-c5e933c22a3c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:50.948917 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fc46b15c-eebd-4beb-9dc4-015b101ef05e tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:50.948917 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fc46b15c-eebd-4beb-9dc4-015b101ef05e tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:50.948917 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fc46b15c-eebd-4beb-9dc4-015b101ef05e tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:50.948917 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fc46b15c-eebd-4beb-9dc4-015b101ef05e tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:50.954393 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8d2ce27c-276e-4333-93c4-c5e933c22a3c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:50.955267 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8d2ce27c-276e-4333-93c4-c5e933c22a3c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:50.956430 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8d2ce27c-276e-4333-93c4-c5e933c22a3c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:50.957243 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8d2ce27c-276e-4333-93c4-c5e933c22a3c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:51.438454 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8d2ce27c-276e-4333-93c4-c5e933c22a3c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:51.445868 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-8d2ce27c-276e-4333-93c4-c5e933c22a3c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.520659 Apr 11 16:35:51.455526 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 32/75] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:50 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:51.460537 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-8df1aaa5-c317-42ec-abb6-b63db4aa8c83 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:51.461139 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-8df1aaa5-c317-42ec-abb6-b63db4aa8c83 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:51.468168 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8df1aaa5-c317-42ec-abb6-b63db4aa8c83 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:51.468772 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8df1aaa5-c317-42ec-abb6-b63db4aa8c83 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:51.469684 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8df1aaa5-c317-42ec-abb6-b63db4aa8c83 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:51.470270 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8df1aaa5-c317-42ec-abb6-b63db4aa8c83 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:51.527956 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-fc46b15c-eebd-4beb-9dc4-015b101ef05e tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:51.538727 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-fc46b15c-eebd-4beb-9dc4-015b101ef05e tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.611090 Apr 11 16:35:51.539910 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 44/76] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:50 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:35:51.583669 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8df1aaa5-c317-42ec-abb6-b63db4aa8c83 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:51.593735 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-8df1aaa5-c317-42ec-abb6-b63db4aa8c83 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1296 microversion: 2.1 time: 0.136996 Apr 11 16:35:51.594610 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 33/77] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:51 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1296 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:51.683105 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3f9fe1d8-d9aa-45a8-a9dc-ccd292a4897c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:51.683994 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3f9fe1d8-d9aa-45a8-a9dc-ccd292a4897c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:51.694231 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3f9fe1d8-d9aa-45a8-a9dc-ccd292a4897c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:51.697402 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3f9fe1d8-d9aa-45a8-a9dc-ccd292a4897c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:51.698340 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3f9fe1d8-d9aa-45a8-a9dc-ccd292a4897c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:51.698860 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3f9fe1d8-d9aa-45a8-a9dc-ccd292a4897c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:51.811665 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3f9fe1d8-d9aa-45a8-a9dc-ccd292a4897c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:51.821704 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3f9fe1d8-d9aa-45a8-a9dc-ccd292a4897c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:51.823192 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3f9fe1d8-d9aa-45a8-a9dc-ccd292a4897c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:51.824419 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3f9fe1d8-d9aa-45a8-a9dc-ccd292a4897c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1338 microversion: 2.20 time: 0.147161 Apr 11 16:35:51.825261 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 45/78] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:35:51 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1338 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:35:52.268432 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-e856c68a-c845-4ccb-a775-c07172981c58 req-4ded69e3-cd94-40b5-8b57-49101f67143c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c", "tag": "397ce2a8-6d73-4bf8-b796-c54287e1035a"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:35:52.294455 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-e856c68a-c845-4ccb-a775-c07172981c58 req-4ded69e3-cd94-40b5-8b57-49101f67143c service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:52.306846 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-e856c68a-c845-4ccb-a775-c07172981c58 req-4ded69e3-cd94-40b5-8b57-49101f67143c service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:52.339146 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-e856c68a-c845-4ccb-a775-c07172981c58 req-4ded69e3-cd94-40b5-8b57-49101f67143c service nova] Creating event network-changed:397ce2a8-6d73-4bf8-b796-c54287e1035a for instance 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c on hv-cinder-83716 Apr 11 16:35:52.344332 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-e856c68a-c845-4ccb-a775-c07172981c58 req-4ded69e3-cd94-40b5-8b57-49101f67143c service nova] Acquired lock "compute-rpcapi-router" {{(pid=123774) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 11 16:35:52.345728 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-283083f6-da57-4637-8bbb-a98916bb2778 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:52.346299 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-283083f6-da57-4637-8bbb-a98916bb2778 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:52.347380 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-283083f6-da57-4637-8bbb-a98916bb2778 None None] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:52.347939 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-283083f6-da57-4637-8bbb-a98916bb2778 None None] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:52.359834 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.compute.rpcapi [None req-283083f6-da57-4637-8bbb-a98916bb2778 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 11 16:35:52.361139 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-283083f6-da57-4637-8bbb-a98916bb2778 None None] Releasing lock "compute-rpcapi-router" {{(pid=123774) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 16:35:52.384302 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-283083f6-da57-4637-8bbb-a98916bb2778 None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119154 Apr 11 16:35:52.385102 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 34/79] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:35:52.463040 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-2978525e-64f1-4676-864c-913953395f4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:52.463552 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-2978525e-64f1-4676-864c-913953395f4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:52.470118 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2978525e-64f1-4676-864c-913953395f4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:52.471792 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2978525e-64f1-4676-864c-913953395f4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:52.472581 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2978525e-64f1-4676-864c-913953395f4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:52.473030 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2978525e-64f1-4676-864c-913953395f4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:52.556872 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-18899189-4829-40c1-a0b2-7a25d8101e12 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:52.558101 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-18899189-4829-40c1-a0b2-7a25d8101e12 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:52.564358 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-18899189-4829-40c1-a0b2-7a25d8101e12 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:52.564799 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-18899189-4829-40c1-a0b2-7a25d8101e12 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:52.565564 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-18899189-4829-40c1-a0b2-7a25d8101e12 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:52.565993 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-18899189-4829-40c1-a0b2-7a25d8101e12 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:52.822798 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-2978525e-64f1-4676-864c-913953395f4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:52.832776 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-2978525e-64f1-4676-864c-913953395f4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.374073 Apr 11 16:35:52.836976 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 46/80] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:52 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:52.853765 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3b4355d7-ea35-4cb7-b35e-99cc808b654a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:52.854803 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3b4355d7-ea35-4cb7-b35e-99cc808b654a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:52.861029 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3b4355d7-ea35-4cb7-b35e-99cc808b654a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:52.861477 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3b4355d7-ea35-4cb7-b35e-99cc808b654a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:52.862282 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3b4355d7-ea35-4cb7-b35e-99cc808b654a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:52.862739 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3b4355d7-ea35-4cb7-b35e-99cc808b654a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:52.947557 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3b4355d7-ea35-4cb7-b35e-99cc808b654a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:52.955137 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3b4355d7-ea35-4cb7-b35e-99cc808b654a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1296 microversion: 2.1 time: 0.116749 Apr 11 16:35:52.956086 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 47/81] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:52 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1296 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:52.961070 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-857b84ff-e0fc-4d49-bbd9-78a7a66cd37b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:52.961669 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-857b84ff-e0fc-4d49-bbd9-78a7a66cd37b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:52.967172 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-18899189-4829-40c1-a0b2-7a25d8101e12 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:52.968435 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-857b84ff-e0fc-4d49-bbd9-78a7a66cd37b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:52.968864 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-857b84ff-e0fc-4d49-bbd9-78a7a66cd37b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:52.969668 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-857b84ff-e0fc-4d49-bbd9-78a7a66cd37b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:52.970100 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-857b84ff-e0fc-4d49-bbd9-78a7a66cd37b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:52.975306 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-18899189-4829-40c1-a0b2-7a25d8101e12 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.423031 Apr 11 16:35:52.985035 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 35/82] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:52 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:53.123597 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-857b84ff-e0fc-4d49-bbd9-78a7a66cd37b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:53.132290 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-857b84ff-e0fc-4d49-bbd9-78a7a66cd37b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:53.133795 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-857b84ff-e0fc-4d49-bbd9-78a7a66cd37b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:53.134894 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-857b84ff-e0fc-4d49-bbd9-78a7a66cd37b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.177812 Apr 11 16:35:53.135482 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 48/83] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:35:52 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:35:53.858448 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-089eaa01-f04e-4abf-943a-e4fe762e1b85 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:53.859040 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-089eaa01-f04e-4abf-943a-e4fe762e1b85 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:53.865205 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-089eaa01-f04e-4abf-943a-e4fe762e1b85 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:53.865634 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-089eaa01-f04e-4abf-943a-e4fe762e1b85 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:53.866770 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-089eaa01-f04e-4abf-943a-e4fe762e1b85 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:53.867586 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-089eaa01-f04e-4abf-943a-e4fe762e1b85 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:53.975841 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c331151b-15b3-4122-8f1c-c006212aff45 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:53.976562 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c331151b-15b3-4122-8f1c-c006212aff45 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:53.982405 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c331151b-15b3-4122-8f1c-c006212aff45 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:53.982833 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c331151b-15b3-4122-8f1c-c006212aff45 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:53.983623 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c331151b-15b3-4122-8f1c-c006212aff45 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:53.984120 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c331151b-15b3-4122-8f1c-c006212aff45 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:53.997965 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-089eaa01-f04e-4abf-943a-e4fe762e1b85 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:54.006684 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-089eaa01-f04e-4abf-943a-e4fe762e1b85 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.152139 Apr 11 16:35:54.007484 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 36/84] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:53 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:54.013477 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-1871d029-0d42-48de-a2f7-c14c65cc9cb8 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:54.014426 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-1871d029-0d42-48de-a2f7-c14c65cc9cb8 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:54.020733 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1871d029-0d42-48de-a2f7-c14c65cc9cb8 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:54.021368 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1871d029-0d42-48de-a2f7-c14c65cc9cb8 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:54.022137 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1871d029-0d42-48de-a2f7-c14c65cc9cb8 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:54.022796 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1871d029-0d42-48de-a2f7-c14c65cc9cb8 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:54.063217 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c331151b-15b3-4122-8f1c-c006212aff45 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:54.071232 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c331151b-15b3-4122-8f1c-c006212aff45 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1296 microversion: 2.1 time: 0.099472 Apr 11 16:35:54.083690 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 49/85] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:53 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1296 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:54.153173 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d63e2fe7-909a-4a6f-8593-0486e49d1e14 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:54.153905 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d63e2fe7-909a-4a6f-8593-0486e49d1e14 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:54.160300 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d63e2fe7-909a-4a6f-8593-0486e49d1e14 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:54.160691 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-1871d029-0d42-48de-a2f7-c14c65cc9cb8 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:54.160823 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d63e2fe7-909a-4a6f-8593-0486e49d1e14 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:54.161502 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d63e2fe7-909a-4a6f-8593-0486e49d1e14 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:54.161919 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d63e2fe7-909a-4a6f-8593-0486e49d1e14 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:54.168809 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-1871d029-0d42-48de-a2f7-c14c65cc9cb8 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.160141 Apr 11 16:35:54.169401 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 37/86] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:54 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:54.299825 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d63e2fe7-909a-4a6f-8593-0486e49d1e14 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:54.308206 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d63e2fe7-909a-4a6f-8593-0486e49d1e14 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:54.309695 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d63e2fe7-909a-4a6f-8593-0486e49d1e14 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:54.310801 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d63e2fe7-909a-4a6f-8593-0486e49d1e14 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.161617 Apr 11 16:35:54.311365 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 50/87] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:35:54 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:35:55.023879 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-bb15dfcf-8560-4ac5-818c-f0bbdcb8c98a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:55.024505 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-bb15dfcf-8560-4ac5-818c-f0bbdcb8c98a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:55.031991 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bb15dfcf-8560-4ac5-818c-f0bbdcb8c98a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:55.032505 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bb15dfcf-8560-4ac5-818c-f0bbdcb8c98a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:55.033644 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bb15dfcf-8560-4ac5-818c-f0bbdcb8c98a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:55.034069 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bb15dfcf-8560-4ac5-818c-f0bbdcb8c98a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:55.089499 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-8f36202c-20ff-46d7-af75-2b0a93337ef0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:55.090592 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-8f36202c-20ff-46d7-af75-2b0a93337ef0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:55.097028 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8f36202c-20ff-46d7-af75-2b0a93337ef0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:55.097595 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8f36202c-20ff-46d7-af75-2b0a93337ef0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:55.098488 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8f36202c-20ff-46d7-af75-2b0a93337ef0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:55.098999 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8f36202c-20ff-46d7-af75-2b0a93337ef0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:55.188455 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-8f36202c-20ff-46d7-af75-2b0a93337ef0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:55.197135 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-8f36202c-20ff-46d7-af75-2b0a93337ef0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1296 microversion: 2.1 time: 0.112046 Apr 11 16:35:55.197998 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 51/88] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:55 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1296 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:35:55.203511 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-14f23954-3382-4d7e-9f59-60e81c25d1c7 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:55.204164 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-14f23954-3382-4d7e-9f59-60e81c25d1c7 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:55.205682 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-bb15dfcf-8560-4ac5-818c-f0bbdcb8c98a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:55.210887 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-14f23954-3382-4d7e-9f59-60e81c25d1c7 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:55.211915 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-14f23954-3382-4d7e-9f59-60e81c25d1c7 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:55.212888 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-14f23954-3382-4d7e-9f59-60e81c25d1c7 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:55.213805 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-bb15dfcf-8560-4ac5-818c-f0bbdcb8c98a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.193916 Apr 11 16:35:55.224114 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 38/89] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:55 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:55.225308 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-14f23954-3382-4d7e-9f59-60e81c25d1c7 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:55.328769 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-15922b79-f020-404f-b4d6-f000165e15d7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:55.329383 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-15922b79-f020-404f-b4d6-f000165e15d7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:55.335956 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-15922b79-f020-404f-b4d6-f000165e15d7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:55.336672 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-15922b79-f020-404f-b4d6-f000165e15d7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:55.337490 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-15922b79-f020-404f-b4d6-f000165e15d7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:55.337935 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-15922b79-f020-404f-b4d6-f000165e15d7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:55.634596 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-14f23954-3382-4d7e-9f59-60e81c25d1c7 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:55.645847 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-14f23954-3382-4d7e-9f59-60e81c25d1c7 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.446289 Apr 11 16:35:55.646994 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 52/90] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:55 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:55.671072 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-15922b79-f020-404f-b4d6-f000165e15d7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:55.680364 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-15922b79-f020-404f-b4d6-f000165e15d7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:55.682121 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-15922b79-f020-404f-b4d6-f000165e15d7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:55.684248 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-15922b79-f020-404f-b4d6-f000165e15d7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.359502 Apr 11 16:35:55.685345 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 39/91] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:35:55 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:35:56.214969 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-07f5fbb2-cebe-451e-912e-7cea83912457 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:56.216380 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-07f5fbb2-cebe-451e-912e-7cea83912457 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:56.231215 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-3e15a1bf-e109-4d30-b5bc-bcf151650596 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:56.231860 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-3e15a1bf-e109-4d30-b5bc-bcf151650596 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:56.233027 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-07f5fbb2-cebe-451e-912e-7cea83912457 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:56.235013 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-07f5fbb2-cebe-451e-912e-7cea83912457 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:56.237248 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-07f5fbb2-cebe-451e-912e-7cea83912457 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:56.238941 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-07f5fbb2-cebe-451e-912e-7cea83912457 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:56.243721 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3e15a1bf-e109-4d30-b5bc-bcf151650596 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:56.246307 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3e15a1bf-e109-4d30-b5bc-bcf151650596 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:56.247483 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3e15a1bf-e109-4d30-b5bc-bcf151650596 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:56.248948 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3e15a1bf-e109-4d30-b5bc-bcf151650596 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:56.578538 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-07f5fbb2-cebe-451e-912e-7cea83912457 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:56.580203 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-3e15a1bf-e109-4d30-b5bc-bcf151650596 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:56.588609 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-3e15a1bf-e109-4d30-b5bc-bcf151650596 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.361696 Apr 11 16:35:56.590380 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 40/92] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:56 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:56.609223 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-a4f0714d-b323-439f-b92b-5f30d2fed336 req-132f2b9e-123c-4b6d-ae50-501f80a2e309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f08685e5-3c41-4032-9633-cc591711221a", "tag": "8b85453b-0363-47d5-9902-93d848d7263e"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:35:56.615207 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-07f5fbb2-cebe-451e-912e-7cea83912457 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.404570 Apr 11 16:35:56.619608 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 53/93] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:56 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:56.624007 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-a4f0714d-b323-439f-b92b-5f30d2fed336 req-132f2b9e-123c-4b6d-ae50-501f80a2e309 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:56.624609 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-a4f0714d-b323-439f-b92b-5f30d2fed336 req-132f2b9e-123c-4b6d-ae50-501f80a2e309 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:56.638233 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-a4f0714d-b323-439f-b92b-5f30d2fed336 req-132f2b9e-123c-4b6d-ae50-501f80a2e309 service nova] Creating event network-changed:8b85453b-0363-47d5-9902-93d848d7263e for instance f08685e5-3c41-4032-9633-cc591711221a on hv-cinder-83716 Apr 11 16:35:56.643429 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-a4f0714d-b323-439f-b92b-5f30d2fed336 req-132f2b9e-123c-4b6d-ae50-501f80a2e309 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051755 Apr 11 16:35:56.644427 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 41/94] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:35:56.665192 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d5f972ad-ea5b-4cba-99ac-4d17084b5a30 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:56.666011 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d5f972ad-ea5b-4cba-99ac-4d17084b5a30 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:56.673079 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d5f972ad-ea5b-4cba-99ac-4d17084b5a30 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:56.673794 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d5f972ad-ea5b-4cba-99ac-4d17084b5a30 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:56.674780 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d5f972ad-ea5b-4cba-99ac-4d17084b5a30 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:56.676216 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d5f972ad-ea5b-4cba-99ac-4d17084b5a30 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:56.704173 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d870efc3-2217-43e0-ad7a-8574abdc3275 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:56.704927 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d870efc3-2217-43e0-ad7a-8574abdc3275 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:56.712149 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d870efc3-2217-43e0-ad7a-8574abdc3275 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:56.712591 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d870efc3-2217-43e0-ad7a-8574abdc3275 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:56.713358 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d870efc3-2217-43e0-ad7a-8574abdc3275 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:56.713782 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d870efc3-2217-43e0-ad7a-8574abdc3275 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:56.941310 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d5f972ad-ea5b-4cba-99ac-4d17084b5a30 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:56.949709 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d870efc3-2217-43e0-ad7a-8574abdc3275 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:56.952004 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d5f972ad-ea5b-4cba-99ac-4d17084b5a30 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.291931 Apr 11 16:35:56.963434 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 54/95] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:56 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:35:56.965841 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d870efc3-2217-43e0-ad7a-8574abdc3275 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:56.968089 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d870efc3-2217-43e0-ad7a-8574abdc3275 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:56.969378 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d870efc3-2217-43e0-ad7a-8574abdc3275 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.270936 Apr 11 16:35:56.969942 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 42/96] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:35:56 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:35:57.617216 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c044c127-65d0-44ce-abed-6aa11410e1b6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:57.618114 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c044c127-65d0-44ce-abed-6aa11410e1b6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:57.627044 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c044c127-65d0-44ce-abed-6aa11410e1b6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:57.627861 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c044c127-65d0-44ce-abed-6aa11410e1b6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:57.628782 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c044c127-65d0-44ce-abed-6aa11410e1b6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:57.629221 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c044c127-65d0-44ce-abed-6aa11410e1b6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:57.636810 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-98c97e16-b113-4dc8-8e1f-9ba8c11dbc7c tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:57.637589 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-98c97e16-b113-4dc8-8e1f-9ba8c11dbc7c tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:57.644013 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-98c97e16-b113-4dc8-8e1f-9ba8c11dbc7c tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:57.644442 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-98c97e16-b113-4dc8-8e1f-9ba8c11dbc7c tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:57.645213 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-98c97e16-b113-4dc8-8e1f-9ba8c11dbc7c tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:57.645636 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-98c97e16-b113-4dc8-8e1f-9ba8c11dbc7c tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:57.858042 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c044c127-65d0-44ce-abed-6aa11410e1b6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:57.869545 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c044c127-65d0-44ce-abed-6aa11410e1b6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.258729 Apr 11 16:35:57.870615 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 55/97] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:57 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:57.874268 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-98c97e16-b113-4dc8-8e1f-9ba8c11dbc7c tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:57.886149 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-98c97e16-b113-4dc8-8e1f-9ba8c11dbc7c tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.253904 Apr 11 16:35:57.886781 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 43/98] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:57 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:57.970445 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-994fe516-8ccf-4dae-a700-0f816430a536 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:57.971049 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-994fe516-8ccf-4dae-a700-0f816430a536 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:57.980171 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-994fe516-8ccf-4dae-a700-0f816430a536 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:57.980696 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-994fe516-8ccf-4dae-a700-0f816430a536 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:57.981891 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-994fe516-8ccf-4dae-a700-0f816430a536 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:57.982635 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-994fe516-8ccf-4dae-a700-0f816430a536 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:57.987281 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-2baf0863-58e8-4b69-8283-04bfdec6a2ed tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:57.989883 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-2baf0863-58e8-4b69-8283-04bfdec6a2ed tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:57.996285 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2baf0863-58e8-4b69-8283-04bfdec6a2ed tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:57.996744 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2baf0863-58e8-4b69-8283-04bfdec6a2ed tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:57.997590 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2baf0863-58e8-4b69-8283-04bfdec6a2ed tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:57.998010 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2baf0863-58e8-4b69-8283-04bfdec6a2ed tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:58.188055 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-994fe516-8ccf-4dae-a700-0f816430a536 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:58.196684 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-2baf0863-58e8-4b69-8283-04bfdec6a2ed tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:58.196969 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-994fe516-8ccf-4dae-a700-0f816430a536 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.230138 Apr 11 16:35:58.202130 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 56/99] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:57 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:58.205611 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-2baf0863-58e8-4b69-8283-04bfdec6a2ed tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:58.207110 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-2baf0863-58e8-4b69-8283-04bfdec6a2ed tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:58.208332 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-2baf0863-58e8-4b69-8283-04bfdec6a2ed tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.225215 Apr 11 16:35:58.208877 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 44/100] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:35:57 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:35:58.887730 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-252468b7-959e-4d2f-9ee7-4f7ce417af2e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:58.888377 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-252468b7-959e-4d2f-9ee7-4f7ce417af2e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:58.894453 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-252468b7-959e-4d2f-9ee7-4f7ce417af2e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:58.894896 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-252468b7-959e-4d2f-9ee7-4f7ce417af2e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:58.895674 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-252468b7-959e-4d2f-9ee7-4f7ce417af2e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:58.896080 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-252468b7-959e-4d2f-9ee7-4f7ce417af2e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:58.904701 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e6450484-22b7-4463-9a82-1b7e3d0625c5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:58.905482 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e6450484-22b7-4463-9a82-1b7e3d0625c5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:58.912543 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e6450484-22b7-4463-9a82-1b7e3d0625c5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:58.913228 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e6450484-22b7-4463-9a82-1b7e3d0625c5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:58.914296 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e6450484-22b7-4463-9a82-1b7e3d0625c5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:58.914843 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e6450484-22b7-4463-9a82-1b7e3d0625c5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:59.093613 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-252468b7-959e-4d2f-9ee7-4f7ce417af2e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:59.101855 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-252468b7-959e-4d2f-9ee7-4f7ce417af2e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.217859 Apr 11 16:35:59.102839 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 57/101] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:58 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:59.105537 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e6450484-22b7-4463-9a82-1b7e3d0625c5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:59.116572 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e6450484-22b7-4463-9a82-1b7e3d0625c5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.215273 Apr 11 16:35:59.117726 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 45/102] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:58 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:59.214512 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-5341c0f4-f05d-4ae3-80ed-41fc8165dcf7 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:59.215014 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-5341c0f4-f05d-4ae3-80ed-41fc8165dcf7 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:59.221384 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5341c0f4-f05d-4ae3-80ed-41fc8165dcf7 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:59.221812 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5341c0f4-f05d-4ae3-80ed-41fc8165dcf7 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:59.222589 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5341c0f4-f05d-4ae3-80ed-41fc8165dcf7 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:59.223008 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5341c0f4-f05d-4ae3-80ed-41fc8165dcf7 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:59.226400 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d8755e41-0378-4804-8491-63c030453e01 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:35:59.226987 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d8755e41-0378-4804-8491-63c030453e01 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:35:59.233299 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d8755e41-0378-4804-8491-63c030453e01 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:59.233917 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d8755e41-0378-4804-8491-63c030453e01 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:59.234569 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d8755e41-0378-4804-8491-63c030453e01 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:35:59.234996 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d8755e41-0378-4804-8491-63c030453e01 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:35:59.424183 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d8755e41-0378-4804-8491-63c030453e01 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:59.427413 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5341c0f4-f05d-4ae3-80ed-41fc8165dcf7 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:59.434853 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d8755e41-0378-4804-8491-63c030453e01 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:59.436040 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-5341c0f4-f05d-4ae3-80ed-41fc8165dcf7 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.225541 Apr 11 16:35:59.436375 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d8755e41-0378-4804-8491-63c030453e01 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:35:59.436645 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 58/103] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:35:59 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:35:59.437477 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d8755e41-0378-4804-8491-63c030453e01 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.215191 Apr 11 16:35:59.438056 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 46/104] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:35:59 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:00.118998 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-63020b76-9149-44e1-9b25-85a3ed0c378e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:00.119586 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-63020b76-9149-44e1-9b25-85a3ed0c378e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:00.125975 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-63020b76-9149-44e1-9b25-85a3ed0c378e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:00.126427 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-63020b76-9149-44e1-9b25-85a3ed0c378e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:00.127197 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-63020b76-9149-44e1-9b25-85a3ed0c378e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:00.127649 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-63020b76-9149-44e1-9b25-85a3ed0c378e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:00.134897 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-eeadfaa8-8443-414c-974c-8c9260a810ea tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:00.135520 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-eeadfaa8-8443-414c-974c-8c9260a810ea tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:00.142300 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-eeadfaa8-8443-414c-974c-8c9260a810ea tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:00.142796 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-eeadfaa8-8443-414c-974c-8c9260a810ea tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:00.143609 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-eeadfaa8-8443-414c-974c-8c9260a810ea tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:00.144073 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-eeadfaa8-8443-414c-974c-8c9260a810ea tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:00.319161 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-63020b76-9149-44e1-9b25-85a3ed0c378e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:00.326197 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-eeadfaa8-8443-414c-974c-8c9260a810ea tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:00.329035 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-63020b76-9149-44e1-9b25-85a3ed0c378e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.214015 Apr 11 16:36:00.329863 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 59/105] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:00 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:00.334237 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-eeadfaa8-8443-414c-974c-8c9260a810ea tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.203606 Apr 11 16:36:00.334842 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 47/106] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:00 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:00.454416 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-61a75364-c448-487c-bd87-712cee2ddd8c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:00.455203 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-61a75364-c448-487c-bd87-712cee2ddd8c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:00.456271 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-de97d1a4-dd43-4de2-a8a5-edc3ae924fd7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:00.457311 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-de97d1a4-dd43-4de2-a8a5-edc3ae924fd7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:00.463111 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-61a75364-c448-487c-bd87-712cee2ddd8c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:00.463797 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-61a75364-c448-487c-bd87-712cee2ddd8c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:00.463947 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-de97d1a4-dd43-4de2-a8a5-edc3ae924fd7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:00.464274 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-de97d1a4-dd43-4de2-a8a5-edc3ae924fd7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:00.464760 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-61a75364-c448-487c-bd87-712cee2ddd8c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:00.465095 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-de97d1a4-dd43-4de2-a8a5-edc3ae924fd7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:00.465400 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-61a75364-c448-487c-bd87-712cee2ddd8c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:00.465587 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-de97d1a4-dd43-4de2-a8a5-edc3ae924fd7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:00.651951 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-de97d1a4-dd43-4de2-a8a5-edc3ae924fd7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:00.658915 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-61a75364-c448-487c-bd87-712cee2ddd8c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:00.660171 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-de97d1a4-dd43-4de2-a8a5-edc3ae924fd7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:00.661708 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-de97d1a4-dd43-4de2-a8a5-edc3ae924fd7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:00.663671 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-de97d1a4-dd43-4de2-a8a5-edc3ae924fd7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.211150 Apr 11 16:36:00.664905 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 48/107] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:00 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:00.667218 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-61a75364-c448-487c-bd87-712cee2ddd8c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.217461 Apr 11 16:36:00.667836 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 60/108] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:00 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:01.346799 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a149be4c-e0df-4f44-bc20-7457c7c4b742 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:01.348023 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a149be4c-e0df-4f44-bc20-7457c7c4b742 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:01.350594 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-add6fd51-53f1-4df0-be1c-9c7b3921a3e7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:01.351352 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-add6fd51-53f1-4df0-be1c-9c7b3921a3e7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:01.354620 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a149be4c-e0df-4f44-bc20-7457c7c4b742 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:01.355056 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a149be4c-e0df-4f44-bc20-7457c7c4b742 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:01.355955 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a149be4c-e0df-4f44-bc20-7457c7c4b742 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:01.356361 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a149be4c-e0df-4f44-bc20-7457c7c4b742 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:01.357482 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-add6fd51-53f1-4df0-be1c-9c7b3921a3e7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:01.357928 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-add6fd51-53f1-4df0-be1c-9c7b3921a3e7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:01.358695 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-add6fd51-53f1-4df0-be1c-9c7b3921a3e7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:01.359128 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-add6fd51-53f1-4df0-be1c-9c7b3921a3e7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:01.563697 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a149be4c-e0df-4f44-bc20-7457c7c4b742 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:01.572862 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a149be4c-e0df-4f44-bc20-7457c7c4b742 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.230097 Apr 11 16:36:01.573476 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 49/109] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:01 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:01.575549 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-add6fd51-53f1-4df0-be1c-9c7b3921a3e7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:01.589048 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-add6fd51-53f1-4df0-be1c-9c7b3921a3e7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.242018 Apr 11 16:36:01.590063 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 61/110] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:01 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:01.684848 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-42cfb89b-5884-456a-9698-c233afd95c06 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:01.685402 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-42cfb89b-5884-456a-9698-c233afd95c06 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:01.687846 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c9aeefdc-93d2-416b-85aa-5217eab490d0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:01.688439 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c9aeefdc-93d2-416b-85aa-5217eab490d0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:01.691781 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-42cfb89b-5884-456a-9698-c233afd95c06 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:01.692219 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-42cfb89b-5884-456a-9698-c233afd95c06 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:01.692984 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-42cfb89b-5884-456a-9698-c233afd95c06 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:01.693398 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-42cfb89b-5884-456a-9698-c233afd95c06 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:01.694588 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c9aeefdc-93d2-416b-85aa-5217eab490d0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:01.695027 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c9aeefdc-93d2-416b-85aa-5217eab490d0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:01.695815 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c9aeefdc-93d2-416b-85aa-5217eab490d0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:01.696243 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c9aeefdc-93d2-416b-85aa-5217eab490d0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:01.886103 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-42cfb89b-5884-456a-9698-c233afd95c06 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:01.890727 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c9aeefdc-93d2-416b-85aa-5217eab490d0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:01.898142 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-42cfb89b-5884-456a-9698-c233afd95c06 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.216330 Apr 11 16:36:01.898856 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 50/111] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:01 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:01.901393 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c9aeefdc-93d2-416b-85aa-5217eab490d0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:01.902880 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c9aeefdc-93d2-416b-85aa-5217eab490d0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:01.903973 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c9aeefdc-93d2-416b-85aa-5217eab490d0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.220015 Apr 11 16:36:01.904522 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 62/112] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:01 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:02.596432 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-17cfc84d-a395-454b-a04a-e0bd02ffe23e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:02.597292 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-17cfc84d-a395-454b-a04a-e0bd02ffe23e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:02.607703 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-17cfc84d-a395-454b-a04a-e0bd02ffe23e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:02.608381 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-17cfc84d-a395-454b-a04a-e0bd02ffe23e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:02.609700 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-17cfc84d-a395-454b-a04a-e0bd02ffe23e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:02.610453 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-17cfc84d-a395-454b-a04a-e0bd02ffe23e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:02.613616 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-78589181-0ac0-4f34-bec9-79ae7715aeee tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:02.614699 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-78589181-0ac0-4f34-bec9-79ae7715aeee tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:02.626774 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-78589181-0ac0-4f34-bec9-79ae7715aeee tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:02.627550 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-78589181-0ac0-4f34-bec9-79ae7715aeee tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:02.628891 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-78589181-0ac0-4f34-bec9-79ae7715aeee tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:02.630646 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-78589181-0ac0-4f34-bec9-79ae7715aeee tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:03.079022 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-17cfc84d-a395-454b-a04a-e0bd02ffe23e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:03.088915 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-17cfc84d-a395-454b-a04a-e0bd02ffe23e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.501894 Apr 11 16:36:03.090166 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 51/113] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:02 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:03.095388 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-20263efb-d89b-448e-966a-97a9f986d554 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:03.096257 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-20263efb-d89b-448e-966a-97a9f986d554 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:03.103026 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-20263efb-d89b-448e-966a-97a9f986d554 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:03.103793 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-20263efb-d89b-448e-966a-97a9f986d554 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:03.104911 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-20263efb-d89b-448e-966a-97a9f986d554 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:03.105530 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-20263efb-d89b-448e-966a-97a9f986d554 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:03.161224 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-78589181-0ac0-4f34-bec9-79ae7715aeee tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:03.172807 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-78589181-0ac0-4f34-bec9-79ae7715aeee tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.567099 Apr 11 16:36:03.174436 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 63/114] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:02 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:03.180588 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-34d076aa-6ac1-4d15-a1c6-80f39a0c9e5f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:03.181412 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-34d076aa-6ac1-4d15-a1c6-80f39a0c9e5f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:03.189088 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-34d076aa-6ac1-4d15-a1c6-80f39a0c9e5f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:03.189924 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-34d076aa-6ac1-4d15-a1c6-80f39a0c9e5f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:03.191136 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-34d076aa-6ac1-4d15-a1c6-80f39a0c9e5f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:03.191803 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-34d076aa-6ac1-4d15-a1c6-80f39a0c9e5f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:03.788527 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-34d076aa-6ac1-4d15-a1c6-80f39a0c9e5f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:03.796881 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-34d076aa-6ac1-4d15-a1c6-80f39a0c9e5f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:03.798389 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-34d076aa-6ac1-4d15-a1c6-80f39a0c9e5f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:03.799540 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-34d076aa-6ac1-4d15-a1c6-80f39a0c9e5f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.623893 Apr 11 16:36:03.808661 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 64/115] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:03 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:03.813484 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-f3f7a075-2252-4fe3-9093-8ecfdc09354e req-dfca13bd-07f8-42a7-b20d-ea3ced809189 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0db1c6a9-bc5a-45f7-bbd3-590292385768", "tag": "a73169ab-a868-4681-96ea-03b1560d84b4"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:36:03.846612 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-f3f7a075-2252-4fe3-9093-8ecfdc09354e req-dfca13bd-07f8-42a7-b20d-ea3ced809189 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:03.847310 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-f3f7a075-2252-4fe3-9093-8ecfdc09354e req-dfca13bd-07f8-42a7-b20d-ea3ced809189 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:03.865785 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-20263efb-d89b-448e-966a-97a9f986d554 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:03.868769 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-f3f7a075-2252-4fe3-9093-8ecfdc09354e req-dfca13bd-07f8-42a7-b20d-ea3ced809189 service nova] Creating event network-changed:a73169ab-a868-4681-96ea-03b1560d84b4 for instance 0db1c6a9-bc5a-45f7-bbd3-590292385768 on hv-cinder-83716 Apr 11 16:36:03.875186 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-f3f7a075-2252-4fe3-9093-8ecfdc09354e req-dfca13bd-07f8-42a7-b20d-ea3ced809189 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065152 Apr 11 16:36:03.875322 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-20263efb-d89b-448e-966a-97a9f986d554 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.783662 Apr 11 16:36:03.875923 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 52/116] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:03 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:03.886494 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 65/117] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:36:04.113182 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-0ec224b9-058a-4c65-a8a1-4dd126ce07ef tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:04.113961 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-0ec224b9-058a-4c65-a8a1-4dd126ce07ef tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:04.120391 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0ec224b9-058a-4c65-a8a1-4dd126ce07ef tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:04.120914 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0ec224b9-058a-4c65-a8a1-4dd126ce07ef tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:04.121690 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0ec224b9-058a-4c65-a8a1-4dd126ce07ef tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:04.122121 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0ec224b9-058a-4c65-a8a1-4dd126ce07ef tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:04.192028 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-03b906d0-a320-4248-a83a-245c9e766ffc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:04.192832 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-03b906d0-a320-4248-a83a-245c9e766ffc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:04.199668 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-03b906d0-a320-4248-a83a-245c9e766ffc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:04.200213 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-03b906d0-a320-4248-a83a-245c9e766ffc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:04.201097 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-03b906d0-a320-4248-a83a-245c9e766ffc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:04.201640 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-03b906d0-a320-4248-a83a-245c9e766ffc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:04.284522 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0ec224b9-058a-4c65-a8a1-4dd126ce07ef tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:04.292856 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-0ec224b9-058a-4c65-a8a1-4dd126ce07ef tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.183532 Apr 11 16:36:04.293434 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 53/118] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:04 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:04.358217 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-03b906d0-a320-4248-a83a-245c9e766ffc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:04.367060 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-03b906d0-a320-4248-a83a-245c9e766ffc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.178902 Apr 11 16:36:04.367589 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 66/119] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:04 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:04.825836 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-96430781-730b-4a0d-8ec9-126a14ae23e0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:04.826529 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-96430781-730b-4a0d-8ec9-126a14ae23e0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:04.832915 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-96430781-730b-4a0d-8ec9-126a14ae23e0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:04.833347 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-96430781-730b-4a0d-8ec9-126a14ae23e0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:04.834116 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-96430781-730b-4a0d-8ec9-126a14ae23e0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:04.834724 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-96430781-730b-4a0d-8ec9-126a14ae23e0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:04.893873 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-abde24f4-b7d7-420d-9d16-30fde38c5661 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:04.894684 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-abde24f4-b7d7-420d-9d16-30fde38c5661 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:04.905452 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-abde24f4-b7d7-420d-9d16-30fde38c5661 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:04.906133 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-abde24f4-b7d7-420d-9d16-30fde38c5661 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:04.908318 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-abde24f4-b7d7-420d-9d16-30fde38c5661 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:04.908884 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-abde24f4-b7d7-420d-9d16-30fde38c5661 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:05.042004 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-96430781-730b-4a0d-8ec9-126a14ae23e0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:05.052371 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-96430781-730b-4a0d-8ec9-126a14ae23e0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:05.054735 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-96430781-730b-4a0d-8ec9-126a14ae23e0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:05.056173 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-96430781-730b-4a0d-8ec9-126a14ae23e0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.234291 Apr 11 16:36:05.057254 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 54/120] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:04 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:05.104957 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-abde24f4-b7d7-420d-9d16-30fde38c5661 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:05.113907 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-abde24f4-b7d7-420d-9d16-30fde38c5661 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.225535 Apr 11 16:36:05.124300 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 67/121] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:04 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:05.313719 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-0f9a6882-e413-49c4-ab8d-f343ca50716b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:05.315544 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-0f9a6882-e413-49c4-ab8d-f343ca50716b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:05.332048 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0f9a6882-e413-49c4-ab8d-f343ca50716b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:05.332822 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0f9a6882-e413-49c4-ab8d-f343ca50716b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:05.334310 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0f9a6882-e413-49c4-ab8d-f343ca50716b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:05.336198 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0f9a6882-e413-49c4-ab8d-f343ca50716b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:05.385103 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-e86d3991-b400-4b8a-9775-b2356b160100 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:05.385789 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-e86d3991-b400-4b8a-9775-b2356b160100 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:05.392113 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e86d3991-b400-4b8a-9775-b2356b160100 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:05.392580 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e86d3991-b400-4b8a-9775-b2356b160100 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:05.393421 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e86d3991-b400-4b8a-9775-b2356b160100 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:05.393824 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e86d3991-b400-4b8a-9775-b2356b160100 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:05.606013 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0f9a6882-e413-49c4-ab8d-f343ca50716b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:05.614926 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-0f9a6882-e413-49c4-ab8d-f343ca50716b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.307862 Apr 11 16:36:05.616180 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 55/122] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:05 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:05.626315 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-e86d3991-b400-4b8a-9775-b2356b160100 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:05.635023 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-e86d3991-b400-4b8a-9775-b2356b160100 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.254001 Apr 11 16:36:05.635801 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 68/123] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:05 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:06.077489 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c29b3bf7-1a62-47e4-89cb-d971375ba83a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:06.078231 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c29b3bf7-1a62-47e4-89cb-d971375ba83a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:06.085863 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c29b3bf7-1a62-47e4-89cb-d971375ba83a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:06.086471 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c29b3bf7-1a62-47e4-89cb-d971375ba83a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:06.087975 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c29b3bf7-1a62-47e4-89cb-d971375ba83a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:06.088446 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c29b3bf7-1a62-47e4-89cb-d971375ba83a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:06.130931 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f6fd9a73-cf26-4fe4-8538-5970059e0923 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:06.131958 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f6fd9a73-cf26-4fe4-8538-5970059e0923 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:06.141025 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f6fd9a73-cf26-4fe4-8538-5970059e0923 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:06.143773 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f6fd9a73-cf26-4fe4-8538-5970059e0923 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:06.144766 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f6fd9a73-cf26-4fe4-8538-5970059e0923 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:06.145459 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f6fd9a73-cf26-4fe4-8538-5970059e0923 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:06.356281 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c29b3bf7-1a62-47e4-89cb-d971375ba83a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:06.364688 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c29b3bf7-1a62-47e4-89cb-d971375ba83a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:06.367018 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c29b3bf7-1a62-47e4-89cb-d971375ba83a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:06.368425 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c29b3bf7-1a62-47e4-89cb-d971375ba83a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.295173 Apr 11 16:36:06.369000 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 56/124] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:06 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:06.415208 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f6fd9a73-cf26-4fe4-8538-5970059e0923 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:06.432092 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f6fd9a73-cf26-4fe4-8538-5970059e0923 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.305205 Apr 11 16:36:06.442720 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 69/125] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:06 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:06.632348 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-2a273b56-3ea4-4dbc-9969-c99efd5e93c2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:06.632971 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-2a273b56-3ea4-4dbc-9969-c99efd5e93c2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:06.639060 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2a273b56-3ea4-4dbc-9969-c99efd5e93c2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:06.640235 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2a273b56-3ea4-4dbc-9969-c99efd5e93c2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:06.641021 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2a273b56-3ea4-4dbc-9969-c99efd5e93c2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:06.641441 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2a273b56-3ea4-4dbc-9969-c99efd5e93c2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:06.653042 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c451f1c3-f47d-4e33-8617-64921204d7ac tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:06.653831 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c451f1c3-f47d-4e33-8617-64921204d7ac tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:06.662508 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c451f1c3-f47d-4e33-8617-64921204d7ac tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:06.662966 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c451f1c3-f47d-4e33-8617-64921204d7ac tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:06.668462 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c451f1c3-f47d-4e33-8617-64921204d7ac tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:06.668908 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c451f1c3-f47d-4e33-8617-64921204d7ac tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:06.879463 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c451f1c3-f47d-4e33-8617-64921204d7ac tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:06.888357 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-2a273b56-3ea4-4dbc-9969-c99efd5e93c2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:06.891968 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c451f1c3-f47d-4e33-8617-64921204d7ac tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.243429 Apr 11 16:36:06.898036 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 70/126] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:06 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:06.900212 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-2a273b56-3ea4-4dbc-9969-c99efd5e93c2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.272139 Apr 11 16:36:06.901347 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 57/127] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:06 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:07.387003 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-0d18a07c-405a-40a8-a342-acb7e5588cd0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:07.387565 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-0d18a07c-405a-40a8-a342-acb7e5588cd0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:07.393879 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0d18a07c-405a-40a8-a342-acb7e5588cd0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:07.394319 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0d18a07c-405a-40a8-a342-acb7e5588cd0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:07.395099 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0d18a07c-405a-40a8-a342-acb7e5588cd0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:07.395666 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0d18a07c-405a-40a8-a342-acb7e5588cd0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:07.450211 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5470b4b2-3130-44e9-a489-f6ce0775ccbf tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:07.450943 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5470b4b2-3130-44e9-a489-f6ce0775ccbf tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:07.458180 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5470b4b2-3130-44e9-a489-f6ce0775ccbf tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:07.458794 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5470b4b2-3130-44e9-a489-f6ce0775ccbf tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:07.459653 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5470b4b2-3130-44e9-a489-f6ce0775ccbf tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:07.460263 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5470b4b2-3130-44e9-a489-f6ce0775ccbf tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:07.622297 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-0d18a07c-405a-40a8-a342-acb7e5588cd0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:07.631169 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-0d18a07c-405a-40a8-a342-acb7e5588cd0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:07.632662 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-0d18a07c-405a-40a8-a342-acb7e5588cd0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:07.634014 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-0d18a07c-405a-40a8-a342-acb7e5588cd0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.250893 Apr 11 16:36:07.634554 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 71/128] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:07 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:07.648365 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5470b4b2-3130-44e9-a489-f6ce0775ccbf tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:07.657272 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5470b4b2-3130-44e9-a489-f6ce0775ccbf tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.209551 Apr 11 16:36:07.657272 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 58/129] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:07 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:07.909873 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-4a201d6a-519d-42b1-8040-29e8ec1cc076 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:07.910482 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-4a201d6a-519d-42b1-8040-29e8ec1cc076 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:07.916944 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-22a2983e-55a1-4724-95ee-20b8f89ce6f3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:07.917528 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-22a2983e-55a1-4724-95ee-20b8f89ce6f3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:07.924591 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-22a2983e-55a1-4724-95ee-20b8f89ce6f3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:07.925032 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-22a2983e-55a1-4724-95ee-20b8f89ce6f3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:07.925805 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-22a2983e-55a1-4724-95ee-20b8f89ce6f3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:07.926230 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-22a2983e-55a1-4724-95ee-20b8f89ce6f3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:07.933907 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4a201d6a-519d-42b1-8040-29e8ec1cc076 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:07.934320 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4a201d6a-519d-42b1-8040-29e8ec1cc076 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:07.935559 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4a201d6a-519d-42b1-8040-29e8ec1cc076 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:07.936159 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4a201d6a-519d-42b1-8040-29e8ec1cc076 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:08.133621 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-4a201d6a-519d-42b1-8040-29e8ec1cc076 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:08.139783 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-22a2983e-55a1-4724-95ee-20b8f89ce6f3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:08.147785 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-22a2983e-55a1-4724-95ee-20b8f89ce6f3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.234519 Apr 11 16:36:08.148593 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 59/130] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:07 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:08.152402 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-4a201d6a-519d-42b1-8040-29e8ec1cc076 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.246172 Apr 11 16:36:08.162664 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 72/131] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:07 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:08.654165 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-13399dd8-3806-499e-8403-17a79664e5de tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:08.655161 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-13399dd8-3806-499e-8403-17a79664e5de tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:08.662614 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-13399dd8-3806-499e-8403-17a79664e5de tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:08.663329 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-13399dd8-3806-499e-8403-17a79664e5de tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:08.664763 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-13399dd8-3806-499e-8403-17a79664e5de tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:08.665380 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-13399dd8-3806-499e-8403-17a79664e5de tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:08.672994 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-820fc4ce-2a4e-47de-bee1-8e7be68da36f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:08.673635 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-820fc4ce-2a4e-47de-bee1-8e7be68da36f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:08.680321 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-820fc4ce-2a4e-47de-bee1-8e7be68da36f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:08.680748 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-820fc4ce-2a4e-47de-bee1-8e7be68da36f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:08.681507 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-820fc4ce-2a4e-47de-bee1-8e7be68da36f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:08.682081 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-820fc4ce-2a4e-47de-bee1-8e7be68da36f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:08.869993 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-13399dd8-3806-499e-8403-17a79664e5de tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:08.874107 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-820fc4ce-2a4e-47de-bee1-8e7be68da36f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:08.879153 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-13399dd8-3806-499e-8403-17a79664e5de tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:08.881283 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-13399dd8-3806-499e-8403-17a79664e5de tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:08.883487 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-13399dd8-3806-499e-8403-17a79664e5de tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.233764 Apr 11 16:36:08.889469 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 60/132] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:08 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:08.892211 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-820fc4ce-2a4e-47de-bee1-8e7be68da36f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.222816 Apr 11 16:36:08.893271 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 73/133] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:08 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:09.165655 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5f0fb3b5-b39b-4fda-b0dd-673be7af99df tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:09.166249 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5f0fb3b5-b39b-4fda-b0dd-673be7af99df tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:09.172385 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5f0fb3b5-b39b-4fda-b0dd-673be7af99df tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:09.172819 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5f0fb3b5-b39b-4fda-b0dd-673be7af99df tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:09.173619 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5f0fb3b5-b39b-4fda-b0dd-673be7af99df tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:09.174165 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5f0fb3b5-b39b-4fda-b0dd-673be7af99df tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:09.179161 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-6982061c-8919-4587-972b-edaa239e57cd tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:09.179161 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-6982061c-8919-4587-972b-edaa239e57cd tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:09.185083 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6982061c-8919-4587-972b-edaa239e57cd tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:09.185547 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6982061c-8919-4587-972b-edaa239e57cd tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:09.186373 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6982061c-8919-4587-972b-edaa239e57cd tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:09.186906 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6982061c-8919-4587-972b-edaa239e57cd tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:09.383078 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5f0fb3b5-b39b-4fda-b0dd-673be7af99df tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:09.390634 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5f0fb3b5-b39b-4fda-b0dd-673be7af99df tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.229231 Apr 11 16:36:09.391075 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 61/134] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:09 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:09.403446 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6982061c-8919-4587-972b-edaa239e57cd tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:09.410923 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-6982061c-8919-4587-972b-edaa239e57cd tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.237365 Apr 11 16:36:09.411790 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 74/135] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:09 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:09.901739 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-aa80bba6-badb-4f3a-820b-54310cb317bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:09.902287 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-aa80bba6-badb-4f3a-820b-54310cb317bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:09.908925 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-aa80bba6-badb-4f3a-820b-54310cb317bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:09.909182 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1cbbc672-609f-4186-bf07-dbaec89d347a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:09.909624 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-aa80bba6-badb-4f3a-820b-54310cb317bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:09.909788 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1cbbc672-609f-4186-bf07-dbaec89d347a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:09.910278 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-aa80bba6-badb-4f3a-820b-54310cb317bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:09.910744 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-aa80bba6-badb-4f3a-820b-54310cb317bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:09.916324 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1cbbc672-609f-4186-bf07-dbaec89d347a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:09.916764 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1cbbc672-609f-4186-bf07-dbaec89d347a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:09.917533 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1cbbc672-609f-4186-bf07-dbaec89d347a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:09.917961 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1cbbc672-609f-4186-bf07-dbaec89d347a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:10.118707 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-aa80bba6-badb-4f3a-820b-54310cb317bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:10.124367 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1cbbc672-609f-4186-bf07-dbaec89d347a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:10.131750 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-aa80bba6-badb-4f3a-820b-54310cb317bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:10.133241 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1cbbc672-609f-4186-bf07-dbaec89d347a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.227785 Apr 11 16:36:10.133458 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-aa80bba6-badb-4f3a-820b-54310cb317bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:10.139723 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 75/136] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:09 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:10.140112 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-aa80bba6-badb-4f3a-820b-54310cb317bd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.237177 Apr 11 16:36:10.140112 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 62/137] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:09 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:10.412331 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-31f21278-1a57-4f86-9930-8bb1eaf49401 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:10.415310 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-31f21278-1a57-4f86-9930-8bb1eaf49401 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:10.429177 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-31f21278-1a57-4f86-9930-8bb1eaf49401 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:10.429705 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-66edcec3-43ee-438c-8095-5edea86f1a56 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:10.430114 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-66edcec3-43ee-438c-8095-5edea86f1a56 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:10.430980 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-31f21278-1a57-4f86-9930-8bb1eaf49401 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:10.432912 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-31f21278-1a57-4f86-9930-8bb1eaf49401 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:10.434201 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-31f21278-1a57-4f86-9930-8bb1eaf49401 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:10.449495 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-66edcec3-43ee-438c-8095-5edea86f1a56 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:10.451482 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-66edcec3-43ee-438c-8095-5edea86f1a56 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:10.453102 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-66edcec3-43ee-438c-8095-5edea86f1a56 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:10.455846 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-66edcec3-43ee-438c-8095-5edea86f1a56 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:10.989645 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-31f21278-1a57-4f86-9930-8bb1eaf49401 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:10.997227 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-31f21278-1a57-4f86-9930-8bb1eaf49401 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.591908 Apr 11 16:36:11.012062 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 76/138] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:10 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:11.021118 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-66edcec3-43ee-438c-8095-5edea86f1a56 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:11.034876 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-66edcec3-43ee-438c-8095-5edea86f1a56 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.609371 Apr 11 16:36:11.035478 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 63/139] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:10 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:11.152564 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-09626ad4-f80d-430c-ac3f-226937422787 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:11.153221 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-0e238e55-c376-4a5d-9d3e-833cc1a2adc5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:11.153740 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-09626ad4-f80d-430c-ac3f-226937422787 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:11.154522 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-0e238e55-c376-4a5d-9d3e-833cc1a2adc5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:11.164793 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0e238e55-c376-4a5d-9d3e-833cc1a2adc5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:11.165949 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0e238e55-c376-4a5d-9d3e-833cc1a2adc5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:11.167041 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0e238e55-c376-4a5d-9d3e-833cc1a2adc5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:11.167733 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0e238e55-c376-4a5d-9d3e-833cc1a2adc5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:11.167842 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-09626ad4-f80d-430c-ac3f-226937422787 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:11.168533 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-09626ad4-f80d-430c-ac3f-226937422787 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:11.171787 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-09626ad4-f80d-430c-ac3f-226937422787 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:11.173114 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-09626ad4-f80d-430c-ac3f-226937422787 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:11.452520 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0e238e55-c376-4a5d-9d3e-833cc1a2adc5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:11.460819 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0e238e55-c376-4a5d-9d3e-833cc1a2adc5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:11.462573 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0e238e55-c376-4a5d-9d3e-833cc1a2adc5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:11.463855 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-0e238e55-c376-4a5d-9d3e-833cc1a2adc5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.315227 Apr 11 16:36:11.464450 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 64/140] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:11 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:11.505645 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-09626ad4-f80d-430c-ac3f-226937422787 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:11.515254 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-09626ad4-f80d-430c-ac3f-226937422787 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.368639 Apr 11 16:36:11.517521 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 77/141] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:11 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:11.544988 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-1a811fcf-ef9f-4af8-a912-27c2655cba43 req-4abe42dc-338c-464b-9180-2d5616103174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3017c9b9-0056-46a2-b176-6036aad45db0", "name": "network-vif-plugged", "status": "completed", "tag": "945545f7-d75c-4885-8d14-73d74d4f110d"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:36:11.554765 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-1a811fcf-ef9f-4af8-a912-27c2655cba43 req-4abe42dc-338c-464b-9180-2d5616103174 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:11.555207 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-1a811fcf-ef9f-4af8-a912-27c2655cba43 req-4abe42dc-338c-464b-9180-2d5616103174 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:11.567013 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-1a811fcf-ef9f-4af8-a912-27c2655cba43 req-4abe42dc-338c-464b-9180-2d5616103174 service nova] Creating event network-vif-plugged:945545f7-d75c-4885-8d14-73d74d4f110d for instance 3017c9b9-0056-46a2-b176-6036aad45db0 on hv-cinder-83716 Apr 11 16:36:11.573075 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-1a811fcf-ef9f-4af8-a912-27c2655cba43 req-4abe42dc-338c-464b-9180-2d5616103174 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107379 Apr 11 16:36:11.576752 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 65/142] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:36:12.013801 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-350df0eb-7ff6-4e43-a1f7-29e19ebec9ef tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:12.014357 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-350df0eb-7ff6-4e43-a1f7-29e19ebec9ef tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:12.020910 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-350df0eb-7ff6-4e43-a1f7-29e19ebec9ef tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:12.021318 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-350df0eb-7ff6-4e43-a1f7-29e19ebec9ef tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:12.022074 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-350df0eb-7ff6-4e43-a1f7-29e19ebec9ef tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:12.022511 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-350df0eb-7ff6-4e43-a1f7-29e19ebec9ef tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:12.053795 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-999a9dca-525c-4370-b1ca-38323cfe0e18 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:12.054634 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-999a9dca-525c-4370-b1ca-38323cfe0e18 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:12.061575 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-999a9dca-525c-4370-b1ca-38323cfe0e18 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:12.062006 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-999a9dca-525c-4370-b1ca-38323cfe0e18 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:12.062780 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-999a9dca-525c-4370-b1ca-38323cfe0e18 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:12.063206 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-999a9dca-525c-4370-b1ca-38323cfe0e18 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:12.211258 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-350df0eb-7ff6-4e43-a1f7-29e19ebec9ef tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:12.218780 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-350df0eb-7ff6-4e43-a1f7-29e19ebec9ef tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.208928 Apr 11 16:36:12.219368 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 78/143] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:12 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:12.235926 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-999a9dca-525c-4370-b1ca-38323cfe0e18 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:12.245922 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-999a9dca-525c-4370-b1ca-38323cfe0e18 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.196464 Apr 11 16:36:12.246541 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 66/144] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:12 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:12.485255 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f50e2fd2-d038-4fab-91ef-f317ae9eb972 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:12.485255 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f50e2fd2-d038-4fab-91ef-f317ae9eb972 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:12.489591 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f50e2fd2-d038-4fab-91ef-f317ae9eb972 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:12.490161 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f50e2fd2-d038-4fab-91ef-f317ae9eb972 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:12.490935 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f50e2fd2-d038-4fab-91ef-f317ae9eb972 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:12.491546 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f50e2fd2-d038-4fab-91ef-f317ae9eb972 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:12.544072 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-95618899-c436-45ed-b0ca-8fa51fbb9d98 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:12.544072 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-95618899-c436-45ed-b0ca-8fa51fbb9d98 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:12.552803 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-95618899-c436-45ed-b0ca-8fa51fbb9d98 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:12.553255 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-95618899-c436-45ed-b0ca-8fa51fbb9d98 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:12.554137 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-95618899-c436-45ed-b0ca-8fa51fbb9d98 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:12.554566 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-95618899-c436-45ed-b0ca-8fa51fbb9d98 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:12.688097 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f50e2fd2-d038-4fab-91ef-f317ae9eb972 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:12.698211 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f50e2fd2-d038-4fab-91ef-f317ae9eb972 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:12.700059 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f50e2fd2-d038-4fab-91ef-f317ae9eb972 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:12.701453 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f50e2fd2-d038-4fab-91ef-f317ae9eb972 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.223132 Apr 11 16:36:12.702534 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 79/145] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:12 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:12.744440 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-95618899-c436-45ed-b0ca-8fa51fbb9d98 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:12.752467 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-95618899-c436-45ed-b0ca-8fa51fbb9d98 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.222280 Apr 11 16:36:12.753336 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 67/146] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:12 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:13.236094 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-5fd9bc7c-e965-461a-a541-bc6c20e1235d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:13.236866 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-5fd9bc7c-e965-461a-a541-bc6c20e1235d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:13.243666 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5fd9bc7c-e965-461a-a541-bc6c20e1235d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:13.244092 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5fd9bc7c-e965-461a-a541-bc6c20e1235d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:13.244855 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5fd9bc7c-e965-461a-a541-bc6c20e1235d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:13.245296 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5fd9bc7c-e965-461a-a541-bc6c20e1235d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:13.264567 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ec4a32b1-50d3-4290-8462-d0430d13f97b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:13.264567 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ec4a32b1-50d3-4290-8462-d0430d13f97b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:13.271010 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ec4a32b1-50d3-4290-8462-d0430d13f97b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:13.271444 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ec4a32b1-50d3-4290-8462-d0430d13f97b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:13.272243 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ec4a32b1-50d3-4290-8462-d0430d13f97b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:13.272788 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ec4a32b1-50d3-4290-8462-d0430d13f97b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:13.634311 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5fd9bc7c-e965-461a-a541-bc6c20e1235d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:13.643232 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-5fd9bc7c-e965-461a-a541-bc6c20e1235d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.410911 Apr 11 16:36:13.653120 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 80/147] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:13 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:13.653577 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ec4a32b1-50d3-4290-8462-d0430d13f97b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:13.658089 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ec4a32b1-50d3-4290-8462-d0430d13f97b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.398232 Apr 11 16:36:13.658661 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 68/148] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:13 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:13.720032 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-e896e121-455c-4566-a9c6-81fb4454f848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:13.720610 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-e896e121-455c-4566-a9c6-81fb4454f848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:13.728247 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e896e121-455c-4566-a9c6-81fb4454f848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:13.728682 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e896e121-455c-4566-a9c6-81fb4454f848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:13.729444 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e896e121-455c-4566-a9c6-81fb4454f848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:13.729856 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e896e121-455c-4566-a9c6-81fb4454f848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:13.770130 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-bec1f30b-ab7b-45c8-841d-a12915f1899c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:13.770774 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-bec1f30b-ab7b-45c8-841d-a12915f1899c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:13.777292 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bec1f30b-ab7b-45c8-841d-a12915f1899c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:13.777703 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bec1f30b-ab7b-45c8-841d-a12915f1899c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:13.778478 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bec1f30b-ab7b-45c8-841d-a12915f1899c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:13.778907 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bec1f30b-ab7b-45c8-841d-a12915f1899c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:13.930006 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-e896e121-455c-4566-a9c6-81fb4454f848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:13.938194 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-e896e121-455c-4566-a9c6-81fb4454f848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:13.939793 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-e896e121-455c-4566-a9c6-81fb4454f848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:13.941012 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-e896e121-455c-4566-a9c6-81fb4454f848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.224968 Apr 11 16:36:13.941647 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 81/149] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:13 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:13.960238 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-bec1f30b-ab7b-45c8-841d-a12915f1899c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:13.968038 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-bec1f30b-ab7b-45c8-841d-a12915f1899c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.201695 Apr 11 16:36:13.968618 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 69/150] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:13 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:14.660979 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-70ffbb3f-b15c-4188-8bad-c0ade800c78a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:14.661511 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-70ffbb3f-b15c-4188-8bad-c0ade800c78a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:14.668688 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-70ffbb3f-b15c-4188-8bad-c0ade800c78a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:14.669123 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-70ffbb3f-b15c-4188-8bad-c0ade800c78a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:14.670065 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-70ffbb3f-b15c-4188-8bad-c0ade800c78a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:14.670356 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-70ffbb3f-b15c-4188-8bad-c0ade800c78a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:14.675029 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-fe2614ba-20d6-4cf5-8cf2-1a86f3bdfe80 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:14.675729 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-fe2614ba-20d6-4cf5-8cf2-1a86f3bdfe80 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:14.682517 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fe2614ba-20d6-4cf5-8cf2-1a86f3bdfe80 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:14.683185 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fe2614ba-20d6-4cf5-8cf2-1a86f3bdfe80 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:14.684290 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fe2614ba-20d6-4cf5-8cf2-1a86f3bdfe80 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:14.684850 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fe2614ba-20d6-4cf5-8cf2-1a86f3bdfe80 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:14.871105 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-70ffbb3f-b15c-4188-8bad-c0ade800c78a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:14.878436 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-fe2614ba-20d6-4cf5-8cf2-1a86f3bdfe80 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:14.880761 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-70ffbb3f-b15c-4188-8bad-c0ade800c78a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.223658 Apr 11 16:36:14.881675 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 82/151] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:14 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:14.887354 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-fe2614ba-20d6-4cf5-8cf2-1a86f3bdfe80 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.216689 Apr 11 16:36:14.888183 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 70/152] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:14 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:14.961454 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3acc0f58-2942-4e82-b372-583a79a149cc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:14.962039 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3acc0f58-2942-4e82-b372-583a79a149cc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:14.968601 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3acc0f58-2942-4e82-b372-583a79a149cc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:14.969047 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3acc0f58-2942-4e82-b372-583a79a149cc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:14.969795 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3acc0f58-2942-4e82-b372-583a79a149cc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:14.970236 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3acc0f58-2942-4e82-b372-583a79a149cc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:14.986732 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d2e04031-34f9-4ccd-949d-6ac9d5438f31 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:14.988041 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d2e04031-34f9-4ccd-949d-6ac9d5438f31 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:14.993757 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d2e04031-34f9-4ccd-949d-6ac9d5438f31 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:14.994199 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d2e04031-34f9-4ccd-949d-6ac9d5438f31 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:14.994944 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d2e04031-34f9-4ccd-949d-6ac9d5438f31 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:14.995390 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d2e04031-34f9-4ccd-949d-6ac9d5438f31 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:15.165980 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3acc0f58-2942-4e82-b372-583a79a149cc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:15.174741 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3acc0f58-2942-4e82-b372-583a79a149cc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:15.178180 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3acc0f58-2942-4e82-b372-583a79a149cc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:15.179225 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d2e04031-34f9-4ccd-949d-6ac9d5438f31 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:15.180312 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3acc0f58-2942-4e82-b372-583a79a149cc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.222766 Apr 11 16:36:15.181425 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 83/153] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:14 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:15.188992 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d2e04031-34f9-4ccd-949d-6ac9d5438f31 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.206169 Apr 11 16:36:15.189619 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 71/154] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:14 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:15.896755 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c1fefacf-ee70-42e4-842c-39f54cc9e940 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:15.897378 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c1fefacf-ee70-42e4-842c-39f54cc9e940 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:15.904062 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c1fefacf-ee70-42e4-842c-39f54cc9e940 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:15.904506 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c1fefacf-ee70-42e4-842c-39f54cc9e940 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:15.905282 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c1fefacf-ee70-42e4-842c-39f54cc9e940 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:15.905707 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c1fefacf-ee70-42e4-842c-39f54cc9e940 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:15.909331 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5e5c8ab9-68d7-45e5-989a-3953c03c5a31 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:15.910053 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5e5c8ab9-68d7-45e5-989a-3953c03c5a31 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:15.919020 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5e5c8ab9-68d7-45e5-989a-3953c03c5a31 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:15.919368 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5e5c8ab9-68d7-45e5-989a-3953c03c5a31 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:15.920177 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5e5c8ab9-68d7-45e5-989a-3953c03c5a31 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:15.920610 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5e5c8ab9-68d7-45e5-989a-3953c03c5a31 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:16.109057 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c1fefacf-ee70-42e4-842c-39f54cc9e940 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:16.112367 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5e5c8ab9-68d7-45e5-989a-3953c03c5a31 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:16.117323 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c1fefacf-ee70-42e4-842c-39f54cc9e940 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.224338 Apr 11 16:36:16.118038 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 84/155] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:15 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:16.120487 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5e5c8ab9-68d7-45e5-989a-3953c03c5a31 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.215392 Apr 11 16:36:16.121140 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 72/156] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:15 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:16.198975 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f90a5630-84e2-493e-83c2-ff50b85e6c5a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:16.199603 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f90a5630-84e2-493e-83c2-ff50b85e6c5a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:16.206412 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f90a5630-84e2-493e-83c2-ff50b85e6c5a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:16.206853 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f90a5630-84e2-493e-83c2-ff50b85e6c5a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:16.207618 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f90a5630-84e2-493e-83c2-ff50b85e6c5a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:16.208081 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f90a5630-84e2-493e-83c2-ff50b85e6c5a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:16.209465 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-6fee4363-b798-4c04-b02f-ce7d9ba3612e tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:16.210093 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-6fee4363-b798-4c04-b02f-ce7d9ba3612e tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:16.216854 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6fee4363-b798-4c04-b02f-ce7d9ba3612e tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:16.217294 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6fee4363-b798-4c04-b02f-ce7d9ba3612e tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:16.218065 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6fee4363-b798-4c04-b02f-ce7d9ba3612e tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:16.218487 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6fee4363-b798-4c04-b02f-ce7d9ba3612e tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:16.399760 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f90a5630-84e2-493e-83c2-ff50b85e6c5a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:16.402364 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-6fee4363-b798-4c04-b02f-ce7d9ba3612e tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:16.407825 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f90a5630-84e2-493e-83c2-ff50b85e6c5a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:16.409328 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f90a5630-84e2-493e-83c2-ff50b85e6c5a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:16.409924 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-6fee4363-b798-4c04-b02f-ce7d9ba3612e tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.204262 Apr 11 16:36:16.410420 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f90a5630-84e2-493e-83c2-ff50b85e6c5a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.215737 Apr 11 16:36:16.411174 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 73/157] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:16 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:16.411302 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 85/158] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:16 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:17.135185 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-23c7ed6a-e558-4aa9-8a36-d9f32cfeb1f7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:17.135843 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-23c7ed6a-e558-4aa9-8a36-d9f32cfeb1f7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:17.137807 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f9101339-4221-496c-80ca-c650719e329f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:17.139782 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f9101339-4221-496c-80ca-c650719e329f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:17.144659 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-23c7ed6a-e558-4aa9-8a36-d9f32cfeb1f7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:17.145102 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-23c7ed6a-e558-4aa9-8a36-d9f32cfeb1f7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:17.146284 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-23c7ed6a-e558-4aa9-8a36-d9f32cfeb1f7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:17.146763 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-23c7ed6a-e558-4aa9-8a36-d9f32cfeb1f7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:17.148308 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f9101339-4221-496c-80ca-c650719e329f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:17.149003 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f9101339-4221-496c-80ca-c650719e329f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:17.150389 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f9101339-4221-496c-80ca-c650719e329f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:17.151031 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f9101339-4221-496c-80ca-c650719e329f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:17.349192 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-23c7ed6a-e558-4aa9-8a36-d9f32cfeb1f7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:17.356890 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f9101339-4221-496c-80ca-c650719e329f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:17.358059 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-23c7ed6a-e558-4aa9-8a36-d9f32cfeb1f7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.228155 Apr 11 16:36:17.358653 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 74/159] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:17 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:17.363439 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-c515b8b8-622a-4540-bd2f-148edc310013 req-2bf215b3-ff36-4cc5-aa02-0bcfb0906477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3dc4a3c-61a6-4e27-af48-37b52aa6a959", "name": "network-vif-plugged", "status": "completed", "tag": "dda955e6-e188-4b67-ae24-2bcd2bd689f7"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:36:17.365181 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f9101339-4221-496c-80ca-c650719e329f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.231454 Apr 11 16:36:17.373053 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-c515b8b8-622a-4540-bd2f-148edc310013 req-2bf215b3-ff36-4cc5-aa02-0bcfb0906477 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:17.373579 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-c515b8b8-622a-4540-bd2f-148edc310013 req-2bf215b3-ff36-4cc5-aa02-0bcfb0906477 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:17.375166 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 86/160] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:17 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:17.385752 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-c515b8b8-622a-4540-bd2f-148edc310013 req-2bf215b3-ff36-4cc5-aa02-0bcfb0906477 service nova] Creating event network-vif-plugged:dda955e6-e188-4b67-ae24-2bcd2bd689f7 for instance a3dc4a3c-61a6-4e27-af48-37b52aa6a959 on hv-cinder-83716 Apr 11 16:36:17.390988 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-c515b8b8-622a-4540-bd2f-148edc310013 req-2bf215b3-ff36-4cc5-aa02-0bcfb0906477 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030836 Apr 11 16:36:17.391817 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 75/161] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:36:17.427855 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-5f03175a-80ec-459d-b67d-96ca74ab8560 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:17.428475 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-5f03175a-80ec-459d-b67d-96ca74ab8560 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:17.430213 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a44727b9-9e7a-488a-8fdc-712d15e2dbd0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:17.430913 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a44727b9-9e7a-488a-8fdc-712d15e2dbd0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:17.434895 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5f03175a-80ec-459d-b67d-96ca74ab8560 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:17.435321 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5f03175a-80ec-459d-b67d-96ca74ab8560 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:17.436102 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5f03175a-80ec-459d-b67d-96ca74ab8560 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:17.436544 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5f03175a-80ec-459d-b67d-96ca74ab8560 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:17.437317 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a44727b9-9e7a-488a-8fdc-712d15e2dbd0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:17.437755 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a44727b9-9e7a-488a-8fdc-712d15e2dbd0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:17.438500 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a44727b9-9e7a-488a-8fdc-712d15e2dbd0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:17.438919 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a44727b9-9e7a-488a-8fdc-712d15e2dbd0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:17.631234 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5f03175a-80ec-459d-b67d-96ca74ab8560 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:17.638817 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-5f03175a-80ec-459d-b67d-96ca74ab8560 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.214859 Apr 11 16:36:17.639420 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 87/162] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:17 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:17.642553 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a44727b9-9e7a-488a-8fdc-712d15e2dbd0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:17.650625 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a44727b9-9e7a-488a-8fdc-712d15e2dbd0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:17.652127 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a44727b9-9e7a-488a-8fdc-712d15e2dbd0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:17.653211 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a44727b9-9e7a-488a-8fdc-712d15e2dbd0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.227383 Apr 11 16:36:17.653770 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 76/163] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:17 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:18.377802 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-160566b5-27ad-4aa0-be86-e4acfc627d46 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:18.379492 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-160566b5-27ad-4aa0-be86-e4acfc627d46 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:18.384433 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-02e172a5-ac61-4077-b4a1-251822e55cf0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:18.384989 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-02e172a5-ac61-4077-b4a1-251822e55cf0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:18.388455 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-160566b5-27ad-4aa0-be86-e4acfc627d46 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:18.388996 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-160566b5-27ad-4aa0-be86-e4acfc627d46 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:18.390232 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-160566b5-27ad-4aa0-be86-e4acfc627d46 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:18.391044 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-160566b5-27ad-4aa0-be86-e4acfc627d46 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:18.400012 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-02e172a5-ac61-4077-b4a1-251822e55cf0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:18.400281 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-02e172a5-ac61-4077-b4a1-251822e55cf0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:18.401049 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-02e172a5-ac61-4077-b4a1-251822e55cf0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:18.404978 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-02e172a5-ac61-4077-b4a1-251822e55cf0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:18.895344 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-160566b5-27ad-4aa0-be86-e4acfc627d46 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:18.903178 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-02e172a5-ac61-4077-b4a1-251822e55cf0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:18.903915 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-160566b5-27ad-4aa0-be86-e4acfc627d46 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.532843 Apr 11 16:36:18.904885 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 88/164] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:18 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:18.911605 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-cb9a9abc-5e74-443a-b14d-ae4215d1211a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:18.912534 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-cb9a9abc-5e74-443a-b14d-ae4215d1211a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:18.912979 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-02e172a5-ac61-4077-b4a1-251822e55cf0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.534349 Apr 11 16:36:18.913884 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 77/165] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:18 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:18.919399 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-586c08d5-9f55-4df4-b80e-18c7512f47e5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:18.919869 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cb9a9abc-5e74-443a-b14d-ae4215d1211a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:18.920019 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-586c08d5-9f55-4df4-b80e-18c7512f47e5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:18.920319 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cb9a9abc-5e74-443a-b14d-ae4215d1211a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:18.921122 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cb9a9abc-5e74-443a-b14d-ae4215d1211a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:18.921553 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cb9a9abc-5e74-443a-b14d-ae4215d1211a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:18.926438 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-586c08d5-9f55-4df4-b80e-18c7512f47e5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:18.927322 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-586c08d5-9f55-4df4-b80e-18c7512f47e5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:18.928218 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-586c08d5-9f55-4df4-b80e-18c7512f47e5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:18.928775 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-586c08d5-9f55-4df4-b80e-18c7512f47e5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:19.137379 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-586c08d5-9f55-4df4-b80e-18c7512f47e5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:19.146419 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-cb9a9abc-5e74-443a-b14d-ae4215d1211a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:19.147336 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-586c08d5-9f55-4df4-b80e-18c7512f47e5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:19.149682 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-586c08d5-9f55-4df4-b80e-18c7512f47e5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:19.153060 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-586c08d5-9f55-4df4-b80e-18c7512f47e5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.238169 Apr 11 16:36:19.153694 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 78/166] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:18 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:19.159124 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-cb9a9abc-5e74-443a-b14d-ae4215d1211a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.252842 Apr 11 16:36:19.162252 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 89/167] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:18 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:19.921375 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-dbe9fd96-9c87-4668-9a44-a620ca66ce60 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:19.922008 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-dbe9fd96-9c87-4668-9a44-a620ca66ce60 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:19.930261 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dbe9fd96-9c87-4668-9a44-a620ca66ce60 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:19.930983 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dbe9fd96-9c87-4668-9a44-a620ca66ce60 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:19.932025 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dbe9fd96-9c87-4668-9a44-a620ca66ce60 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:19.932366 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-fdacda89-31df-4163-ba7c-b2e25d57e678 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:19.933562 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dbe9fd96-9c87-4668-9a44-a620ca66ce60 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:19.933665 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-fdacda89-31df-4163-ba7c-b2e25d57e678 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:19.948577 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fdacda89-31df-4163-ba7c-b2e25d57e678 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:19.949106 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fdacda89-31df-4163-ba7c-b2e25d57e678 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:19.950601 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fdacda89-31df-4163-ba7c-b2e25d57e678 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:19.952303 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fdacda89-31df-4163-ba7c-b2e25d57e678 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:20.230757 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-fdacda89-31df-4163-ba7c-b2e25d57e678 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:20.238378 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-fdacda89-31df-4163-ba7c-b2e25d57e678 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.311383 Apr 11 16:36:20.238953 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 90/168] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:19 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:20.241795 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-dbe9fd96-9c87-4668-9a44-a620ca66ce60 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:20.244436 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f662e8db-1a8a-4b83-930f-d7910f11b48f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:20.245525 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f662e8db-1a8a-4b83-930f-d7910f11b48f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:20.250630 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-dbe9fd96-9c87-4668-9a44-a620ca66ce60 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.333447 Apr 11 16:36:20.259709 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 79/169] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:19 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:20.260154 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f662e8db-1a8a-4b83-930f-d7910f11b48f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:20.260154 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f662e8db-1a8a-4b83-930f-d7910f11b48f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:20.260154 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f662e8db-1a8a-4b83-930f-d7910f11b48f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:20.260154 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f662e8db-1a8a-4b83-930f-d7910f11b48f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:20.260475 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-77e0e701-c9e6-4eab-b74c-b2adc43a1c9a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:20.260475 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-77e0e701-c9e6-4eab-b74c-b2adc43a1c9a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:20.263126 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-77e0e701-c9e6-4eab-b74c-b2adc43a1c9a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:20.263572 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-77e0e701-c9e6-4eab-b74c-b2adc43a1c9a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:20.264350 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-77e0e701-c9e6-4eab-b74c-b2adc43a1c9a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:20.264812 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-77e0e701-c9e6-4eab-b74c-b2adc43a1c9a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:20.460799 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f662e8db-1a8a-4b83-930f-d7910f11b48f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:20.464584 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-77e0e701-c9e6-4eab-b74c-b2adc43a1c9a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:20.472448 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-77e0e701-c9e6-4eab-b74c-b2adc43a1c9a tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.220173 Apr 11 16:36:20.473039 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 80/170] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:20 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:20.481974 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f662e8db-1a8a-4b83-930f-d7910f11b48f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:20.483464 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f662e8db-1a8a-4b83-930f-d7910f11b48f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:20.484709 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f662e8db-1a8a-4b83-930f-d7910f11b48f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.244439 Apr 11 16:36:20.485488 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 91/171] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:20 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:21.268809 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1c80c956-dfe4-4e5a-ac2a-9c990a54b20a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:21.269554 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1c80c956-dfe4-4e5a-ac2a-9c990a54b20a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:21.276630 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1c80c956-dfe4-4e5a-ac2a-9c990a54b20a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:21.277469 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-1a9654ae-568f-4191-aa65-701eba8eb71b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:21.278217 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1c80c956-dfe4-4e5a-ac2a-9c990a54b20a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:21.278335 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-1a9654ae-568f-4191-aa65-701eba8eb71b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:21.279571 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1c80c956-dfe4-4e5a-ac2a-9c990a54b20a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:21.280170 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1c80c956-dfe4-4e5a-ac2a-9c990a54b20a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:21.291464 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1a9654ae-568f-4191-aa65-701eba8eb71b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:21.291931 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1a9654ae-568f-4191-aa65-701eba8eb71b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:21.292710 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1a9654ae-568f-4191-aa65-701eba8eb71b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:21.293139 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1a9654ae-568f-4191-aa65-701eba8eb71b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:21.570828 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-1a9654ae-568f-4191-aa65-701eba8eb71b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:21.586328 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-1a9654ae-568f-4191-aa65-701eba8eb71b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.333277 Apr 11 16:36:21.588187 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 81/172] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:21 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:21.592265 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1c80c956-dfe4-4e5a-ac2a-9c990a54b20a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:21.607376 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1c80c956-dfe4-4e5a-ac2a-9c990a54b20a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.341518 Apr 11 16:36:21.618916 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 92/173] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:21 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:21.620985 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-2afed4a8-e5b2-4412-9a90-5ce11b72a2de req-f5edba1b-0b23-4d10-8656-8668d4ef9c56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c", "name": "network-vif-plugged", "status": "completed", "tag": "397ce2a8-6d73-4bf8-b796-c54287e1035a"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:36:21.631362 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-9153e957-26ae-4603-a342-bede14a67b60 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:21.632278 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-9153e957-26ae-4603-a342-bede14a67b60 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:21.639499 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-2afed4a8-e5b2-4412-9a90-5ce11b72a2de req-f5edba1b-0b23-4d10-8656-8668d4ef9c56 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:21.641351 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-2afed4a8-e5b2-4412-9a90-5ce11b72a2de req-f5edba1b-0b23-4d10-8656-8668d4ef9c56 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:21.646735 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9153e957-26ae-4603-a342-bede14a67b60 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:21.648637 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9153e957-26ae-4603-a342-bede14a67b60 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:21.649430 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9153e957-26ae-4603-a342-bede14a67b60 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:21.649850 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9153e957-26ae-4603-a342-bede14a67b60 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:21.666227 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-2afed4a8-e5b2-4412-9a90-5ce11b72a2de req-f5edba1b-0b23-4d10-8656-8668d4ef9c56 service nova] Creating event network-vif-plugged:397ce2a8-6d73-4bf8-b796-c54287e1035a for instance 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c on hv-cinder-83716 Apr 11 16:36:21.682291 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-2afed4a8-e5b2-4412-9a90-5ce11b72a2de req-f5edba1b-0b23-4d10-8656-8668d4ef9c56 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092429 Apr 11 16:36:21.682738 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 82/174] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:36:21.693799 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-52e4ab29-eea4-4a69-98fc-b4e940dc7cd8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:21.694638 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-52e4ab29-eea4-4a69-98fc-b4e940dc7cd8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:21.708258 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-52e4ab29-eea4-4a69-98fc-b4e940dc7cd8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:21.708705 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-52e4ab29-eea4-4a69-98fc-b4e940dc7cd8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:21.709483 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-52e4ab29-eea4-4a69-98fc-b4e940dc7cd8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:21.710173 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-52e4ab29-eea4-4a69-98fc-b4e940dc7cd8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:21.947207 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9153e957-26ae-4603-a342-bede14a67b60 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:21.951450 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-52e4ab29-eea4-4a69-98fc-b4e940dc7cd8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:21.959098 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-9153e957-26ae-4603-a342-bede14a67b60 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.338307 Apr 11 16:36:21.962257 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 93/175] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:21 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:21.962529 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-52e4ab29-eea4-4a69-98fc-b4e940dc7cd8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:21.964253 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-52e4ab29-eea4-4a69-98fc-b4e940dc7cd8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:21.965548 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-52e4ab29-eea4-4a69-98fc-b4e940dc7cd8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.278048 Apr 11 16:36:21.966249 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 83/176] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:21 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:22.604994 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-51a077bc-fb5e-4a74-9640-ecb7a292cd11 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:22.605712 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-51a077bc-fb5e-4a74-9640-ecb7a292cd11 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:22.611925 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-51a077bc-fb5e-4a74-9640-ecb7a292cd11 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:22.612375 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-51a077bc-fb5e-4a74-9640-ecb7a292cd11 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:22.613163 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-51a077bc-fb5e-4a74-9640-ecb7a292cd11 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:22.613602 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-51a077bc-fb5e-4a74-9640-ecb7a292cd11 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:22.626327 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-02a27776-4ec2-4b52-b722-1f8799662d70 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:22.627682 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-02a27776-4ec2-4b52-b722-1f8799662d70 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:22.645872 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-02a27776-4ec2-4b52-b722-1f8799662d70 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:22.646319 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-02a27776-4ec2-4b52-b722-1f8799662d70 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:22.647100 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-02a27776-4ec2-4b52-b722-1f8799662d70 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:22.647569 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-02a27776-4ec2-4b52-b722-1f8799662d70 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:22.826923 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-51a077bc-fb5e-4a74-9640-ecb7a292cd11 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:22.835008 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-51a077bc-fb5e-4a74-9640-ecb7a292cd11 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.233876 Apr 11 16:36:22.841991 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 94/177] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:22 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:22.842082 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-02a27776-4ec2-4b52-b722-1f8799662d70 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:22.848633 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-02a27776-4ec2-4b52-b722-1f8799662d70 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.226043 Apr 11 16:36:22.849365 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 84/178] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:22 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:22.978566 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1e18d23c-4520-48fd-bfee-e64bed1ee27f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:22.979172 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1e18d23c-4520-48fd-bfee-e64bed1ee27f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:22.985692 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1e18d23c-4520-48fd-bfee-e64bed1ee27f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:22.986112 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1e18d23c-4520-48fd-bfee-e64bed1ee27f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:22.986875 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1e18d23c-4520-48fd-bfee-e64bed1ee27f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:22.987297 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1e18d23c-4520-48fd-bfee-e64bed1ee27f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:22.988884 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-802f6415-d539-4bdc-9d84-da665988aac7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:22.990034 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-802f6415-d539-4bdc-9d84-da665988aac7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:22.999442 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-802f6415-d539-4bdc-9d84-da665988aac7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:23.000198 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-802f6415-d539-4bdc-9d84-da665988aac7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:23.001623 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-802f6415-d539-4bdc-9d84-da665988aac7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:23.002341 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-802f6415-d539-4bdc-9d84-da665988aac7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:23.189929 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1e18d23c-4520-48fd-bfee-e64bed1ee27f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:23.197628 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-802f6415-d539-4bdc-9d84-da665988aac7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:23.197808 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1e18d23c-4520-48fd-bfee-e64bed1ee27f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.223348 Apr 11 16:36:23.198328 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 95/179] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:22 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:23.209138 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-802f6415-d539-4bdc-9d84-da665988aac7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:23.210679 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-802f6415-d539-4bdc-9d84-da665988aac7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:23.212185 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-802f6415-d539-4bdc-9d84-da665988aac7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.230191 Apr 11 16:36:23.212765 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 85/180] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:22 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:23.852660 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-81dbbf8b-42cb-49bc-b1f3-4807684e04b5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:23.853255 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-81dbbf8b-42cb-49bc-b1f3-4807684e04b5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:23.860008 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-81dbbf8b-42cb-49bc-b1f3-4807684e04b5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:23.860796 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-81dbbf8b-42cb-49bc-b1f3-4807684e04b5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:23.861870 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-81dbbf8b-42cb-49bc-b1f3-4807684e04b5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:23.862294 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-81dbbf8b-42cb-49bc-b1f3-4807684e04b5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:23.865508 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d09ca25c-fd34-4045-86b0-dc71ee60488c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:23.866373 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d09ca25c-fd34-4045-86b0-dc71ee60488c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:23.873358 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d09ca25c-fd34-4045-86b0-dc71ee60488c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:23.874007 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d09ca25c-fd34-4045-86b0-dc71ee60488c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:23.875150 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d09ca25c-fd34-4045-86b0-dc71ee60488c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:23.875687 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d09ca25c-fd34-4045-86b0-dc71ee60488c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:24.064956 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-81dbbf8b-42cb-49bc-b1f3-4807684e04b5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:24.067767 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d09ca25c-fd34-4045-86b0-dc71ee60488c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:24.073655 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-81dbbf8b-42cb-49bc-b1f3-4807684e04b5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.225010 Apr 11 16:36:24.074466 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 96/181] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:23 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:24.086609 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d09ca25c-fd34-4045-86b0-dc71ee60488c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.214607 Apr 11 16:36:24.086609 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 86/182] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:23 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:24.215912 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-859fbcda-8d7b-4b7c-b9a2-9fbf3e035c9f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:24.216466 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-859fbcda-8d7b-4b7c-b9a2-9fbf3e035c9f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:24.222867 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-859fbcda-8d7b-4b7c-b9a2-9fbf3e035c9f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:24.223300 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-859fbcda-8d7b-4b7c-b9a2-9fbf3e035c9f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:24.224088 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-859fbcda-8d7b-4b7c-b9a2-9fbf3e035c9f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:24.224653 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-859fbcda-8d7b-4b7c-b9a2-9fbf3e035c9f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:24.232469 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-10c9eecd-84ca-473c-9bd3-5a5cf7b31523 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:24.233071 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-10c9eecd-84ca-473c-9bd3-5a5cf7b31523 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:24.243557 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-10c9eecd-84ca-473c-9bd3-5a5cf7b31523 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:24.244198 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-10c9eecd-84ca-473c-9bd3-5a5cf7b31523 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:24.245015 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-10c9eecd-84ca-473c-9bd3-5a5cf7b31523 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:24.245442 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-10c9eecd-84ca-473c-9bd3-5a5cf7b31523 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:24.454195 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-859fbcda-8d7b-4b7c-b9a2-9fbf3e035c9f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:24.456142 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-10c9eecd-84ca-473c-9bd3-5a5cf7b31523 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:24.462842 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-859fbcda-8d7b-4b7c-b9a2-9fbf3e035c9f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.251023 Apr 11 16:36:24.464837 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 87/183] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:24 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:24.479922 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-10c9eecd-84ca-473c-9bd3-5a5cf7b31523 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:24.479922 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-10c9eecd-84ca-473c-9bd3-5a5cf7b31523 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:24.479922 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-10c9eecd-84ca-473c-9bd3-5a5cf7b31523 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.250880 Apr 11 16:36:24.480248 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 97/184] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:24 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:25.091178 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-2309dec9-9f9a-47fc-8cc1-c528e4a8d1b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:25.091790 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-2309dec9-9f9a-47fc-8cc1-c528e4a8d1b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:25.094176 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-36b6f0fd-f710-410e-84c4-1e677887d80d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:25.094775 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-36b6f0fd-f710-410e-84c4-1e677887d80d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:25.098392 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2309dec9-9f9a-47fc-8cc1-c528e4a8d1b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:25.098852 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2309dec9-9f9a-47fc-8cc1-c528e4a8d1b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:25.099602 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2309dec9-9f9a-47fc-8cc1-c528e4a8d1b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:25.100061 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2309dec9-9f9a-47fc-8cc1-c528e4a8d1b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:25.101041 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-36b6f0fd-f710-410e-84c4-1e677887d80d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:25.101494 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-36b6f0fd-f710-410e-84c4-1e677887d80d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:25.102246 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-36b6f0fd-f710-410e-84c4-1e677887d80d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:25.102673 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-36b6f0fd-f710-410e-84c4-1e677887d80d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:25.300316 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-2309dec9-9f9a-47fc-8cc1-c528e4a8d1b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:25.304155 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-36b6f0fd-f710-410e-84c4-1e677887d80d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:25.308555 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-2309dec9-9f9a-47fc-8cc1-c528e4a8d1b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.221183 Apr 11 16:36:25.309595 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 88/185] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:25 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:25.312752 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-36b6f0fd-f710-410e-84c4-1e677887d80d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.222481 Apr 11 16:36:25.313392 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 98/186] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:25 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:25.481489 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a2ea2e8f-9e81-4b83-b028-1bcc2ea0c78d tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:25.482070 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a2ea2e8f-9e81-4b83-b028-1bcc2ea0c78d tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:25.489216 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a2ea2e8f-9e81-4b83-b028-1bcc2ea0c78d tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:25.489859 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a2ea2e8f-9e81-4b83-b028-1bcc2ea0c78d tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:25.491056 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a2ea2e8f-9e81-4b83-b028-1bcc2ea0c78d tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:25.491941 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a2ea2e8f-9e81-4b83-b028-1bcc2ea0c78d tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:25.495766 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-17e165cc-12b3-49e6-9618-bf720d224ed7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:25.496533 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-17e165cc-12b3-49e6-9618-bf720d224ed7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:25.505609 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-17e165cc-12b3-49e6-9618-bf720d224ed7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:25.506086 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-17e165cc-12b3-49e6-9618-bf720d224ed7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:25.507080 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-17e165cc-12b3-49e6-9618-bf720d224ed7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:25.507500 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-17e165cc-12b3-49e6-9618-bf720d224ed7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:25.901750 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a2ea2e8f-9e81-4b83-b028-1bcc2ea0c78d tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:25.905162 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-17e165cc-12b3-49e6-9618-bf720d224ed7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:25.910585 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a2ea2e8f-9e81-4b83-b028-1bcc2ea0c78d tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.433182 Apr 11 16:36:25.911313 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 89/187] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:25 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:25.915780 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-17e165cc-12b3-49e6-9618-bf720d224ed7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:25.917279 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-17e165cc-12b3-49e6-9618-bf720d224ed7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:25.918733 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-17e165cc-12b3-49e6-9618-bf720d224ed7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.427468 Apr 11 16:36:25.919934 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 99/188] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:25 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:26.325829 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-42f34a87-2732-418a-92f8-68012dc69f73 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:26.326396 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-42f34a87-2732-418a-92f8-68012dc69f73 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:26.329792 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-08b33855-d346-4abe-92c6-2ee99c65986c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:26.330363 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-08b33855-d346-4abe-92c6-2ee99c65986c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:26.332739 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-42f34a87-2732-418a-92f8-68012dc69f73 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:26.333179 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-42f34a87-2732-418a-92f8-68012dc69f73 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:26.333944 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-42f34a87-2732-418a-92f8-68012dc69f73 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:26.334366 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-42f34a87-2732-418a-92f8-68012dc69f73 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:26.336834 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-08b33855-d346-4abe-92c6-2ee99c65986c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:26.337478 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-08b33855-d346-4abe-92c6-2ee99c65986c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:26.338685 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-08b33855-d346-4abe-92c6-2ee99c65986c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:26.340194 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-08b33855-d346-4abe-92c6-2ee99c65986c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:26.542869 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-42f34a87-2732-418a-92f8-68012dc69f73 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:26.545880 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-08b33855-d346-4abe-92c6-2ee99c65986c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:26.551026 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-42f34a87-2732-418a-92f8-68012dc69f73 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.229060 Apr 11 16:36:26.552175 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 90/189] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:26 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:26.555162 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-08b33855-d346-4abe-92c6-2ee99c65986c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.229062 Apr 11 16:36:26.556182 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 100/190] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:26 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:26.929758 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f0fcb87d-df09-4ef0-8b31-f04bb2346450 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:26.930477 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f0fcb87d-df09-4ef0-8b31-f04bb2346450 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:26.938118 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f0fcb87d-df09-4ef0-8b31-f04bb2346450 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:26.938874 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f0fcb87d-df09-4ef0-8b31-f04bb2346450 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:26.939951 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f0fcb87d-df09-4ef0-8b31-f04bb2346450 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:26.940878 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f0fcb87d-df09-4ef0-8b31-f04bb2346450 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:26.942092 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-450ce703-2adc-4c1e-b19f-f166b0c577d3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:26.942980 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-450ce703-2adc-4c1e-b19f-f166b0c577d3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:26.950714 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-450ce703-2adc-4c1e-b19f-f166b0c577d3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:26.951168 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-450ce703-2adc-4c1e-b19f-f166b0c577d3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:26.952247 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-450ce703-2adc-4c1e-b19f-f166b0c577d3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:26.952901 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-450ce703-2adc-4c1e-b19f-f166b0c577d3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:27.142801 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f0fcb87d-df09-4ef0-8b31-f04bb2346450 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:27.146766 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-450ce703-2adc-4c1e-b19f-f166b0c577d3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:27.152456 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f0fcb87d-df09-4ef0-8b31-f04bb2346450 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.228084 Apr 11 16:36:27.162721 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 91/191] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:26 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:27.164207 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-450ce703-2adc-4c1e-b19f-f166b0c577d3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:27.165714 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-450ce703-2adc-4c1e-b19f-f166b0c577d3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:27.166795 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-450ce703-2adc-4c1e-b19f-f166b0c577d3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.232210 Apr 11 16:36:27.167795 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 101/192] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:26 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:27.571484 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-700b484c-94fa-4c7b-a028-9a4032197547 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:27.573088 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-700b484c-94fa-4c7b-a028-9a4032197547 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:27.581770 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-700b484c-94fa-4c7b-a028-9a4032197547 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:27.582417 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-700b484c-94fa-4c7b-a028-9a4032197547 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:27.583401 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-700b484c-94fa-4c7b-a028-9a4032197547 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:27.584077 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-700b484c-94fa-4c7b-a028-9a4032197547 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:27.598077 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-2d59791e-48f5-4e3b-9fd8-cd603bd8a095 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:27.598077 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-2d59791e-48f5-4e3b-9fd8-cd603bd8a095 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:27.601849 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2d59791e-48f5-4e3b-9fd8-cd603bd8a095 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:27.602285 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2d59791e-48f5-4e3b-9fd8-cd603bd8a095 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:27.603399 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2d59791e-48f5-4e3b-9fd8-cd603bd8a095 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:27.605323 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2d59791e-48f5-4e3b-9fd8-cd603bd8a095 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:27.858760 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-2d59791e-48f5-4e3b-9fd8-cd603bd8a095 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:27.868579 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-2d59791e-48f5-4e3b-9fd8-cd603bd8a095 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.300868 Apr 11 16:36:27.869650 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 102/193] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:27 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:27.874963 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-62de3a3e-33b9-4c32-94b2-6f9bda99779d req-1eeabde1-3996-4236-ba1c-131edf5fc1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08685e5-3c41-4032-9633-cc591711221a", "name": "network-vif-plugged", "status": "completed", "tag": "8b85453b-0363-47d5-9902-93d848d7263e"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:36:27.887262 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-700b484c-94fa-4c7b-a028-9a4032197547 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:27.895965 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-700b484c-94fa-4c7b-a028-9a4032197547 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.328837 Apr 11 16:36:27.896861 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-62de3a3e-33b9-4c32-94b2-6f9bda99779d req-1eeabde1-3996-4236-ba1c-131edf5fc1eb service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:27.897415 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-62de3a3e-33b9-4c32-94b2-6f9bda99779d req-1eeabde1-3996-4236-ba1c-131edf5fc1eb service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:27.899705 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 92/194] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:27 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:27.910169 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-62de3a3e-33b9-4c32-94b2-6f9bda99779d req-1eeabde1-3996-4236-ba1c-131edf5fc1eb service nova] Creating event network-vif-plugged:8b85453b-0363-47d5-9902-93d848d7263e for instance f08685e5-3c41-4032-9633-cc591711221a on hv-cinder-83716 Apr 11 16:36:27.916001 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-62de3a3e-33b9-4c32-94b2-6f9bda99779d req-1eeabde1-3996-4236-ba1c-131edf5fc1eb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044840 Apr 11 16:36:27.916664 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 103/195] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:36:28.170209 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-7f762125-5434-408e-9b41-d471a6effa5b tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:28.170841 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-7f762125-5434-408e-9b41-d471a6effa5b tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:28.177249 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7f762125-5434-408e-9b41-d471a6effa5b tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:28.177719 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7f762125-5434-408e-9b41-d471a6effa5b tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:28.178570 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7f762125-5434-408e-9b41-d471a6effa5b tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:28.179076 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7f762125-5434-408e-9b41-d471a6effa5b tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:28.188879 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-fdea4f7e-7a1d-4899-809f-c02b4467b021 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:28.189898 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-fdea4f7e-7a1d-4899-809f-c02b4467b021 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:28.204353 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fdea4f7e-7a1d-4899-809f-c02b4467b021 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:28.204933 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fdea4f7e-7a1d-4899-809f-c02b4467b021 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:28.206197 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fdea4f7e-7a1d-4899-809f-c02b4467b021 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:28.206197 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fdea4f7e-7a1d-4899-809f-c02b4467b021 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:28.392729 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-7f762125-5434-408e-9b41-d471a6effa5b tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:28.400677 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-7f762125-5434-408e-9b41-d471a6effa5b tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.234430 Apr 11 16:36:28.401908 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 93/196] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:28 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:28.411431 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-fdea4f7e-7a1d-4899-809f-c02b4467b021 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:28.421927 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-fdea4f7e-7a1d-4899-809f-c02b4467b021 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:28.423536 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-fdea4f7e-7a1d-4899-809f-c02b4467b021 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:28.424813 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-fdea4f7e-7a1d-4899-809f-c02b4467b021 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.241973 Apr 11 16:36:28.426055 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 104/197] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:28 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:28.886685 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-840f75c3-39cb-4d38-9af0-6f0e3f5665f6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:28.887283 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-840f75c3-39cb-4d38-9af0-6f0e3f5665f6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:28.893821 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-840f75c3-39cb-4d38-9af0-6f0e3f5665f6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:28.894684 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-840f75c3-39cb-4d38-9af0-6f0e3f5665f6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:28.895055 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-840f75c3-39cb-4d38-9af0-6f0e3f5665f6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:28.895480 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-840f75c3-39cb-4d38-9af0-6f0e3f5665f6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:28.926787 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-bea4c0eb-ebd7-4383-949f-717b4d030c01 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:28.927394 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-bea4c0eb-ebd7-4383-949f-717b4d030c01 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:28.934694 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bea4c0eb-ebd7-4383-949f-717b4d030c01 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:28.935313 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bea4c0eb-ebd7-4383-949f-717b4d030c01 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:28.936346 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bea4c0eb-ebd7-4383-949f-717b4d030c01 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:28.937174 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bea4c0eb-ebd7-4383-949f-717b4d030c01 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:29.128423 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-840f75c3-39cb-4d38-9af0-6f0e3f5665f6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:29.141045 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-840f75c3-39cb-4d38-9af0-6f0e3f5665f6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.258205 Apr 11 16:36:29.142056 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 94/198] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:28 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:29.158051 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-bea4c0eb-ebd7-4383-949f-717b4d030c01 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:29.166355 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-bea4c0eb-ebd7-4383-949f-717b4d030c01 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.250873 Apr 11 16:36:29.166935 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 105/199] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:28 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:29.418583 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-0060e4a1-1851-4876-b0f3-225f5cca1289 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:29.419132 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-0060e4a1-1851-4876-b0f3-225f5cca1289 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:29.425658 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0060e4a1-1851-4876-b0f3-225f5cca1289 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:29.426353 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0060e4a1-1851-4876-b0f3-225f5cca1289 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:29.427348 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0060e4a1-1851-4876-b0f3-225f5cca1289 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:29.427993 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0060e4a1-1851-4876-b0f3-225f5cca1289 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:29.446118 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-697a75a0-8a0d-414d-a2d3-1dc9b2c03d81 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:29.446726 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-697a75a0-8a0d-414d-a2d3-1dc9b2c03d81 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:29.452985 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-697a75a0-8a0d-414d-a2d3-1dc9b2c03d81 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:29.453688 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-697a75a0-8a0d-414d-a2d3-1dc9b2c03d81 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:29.454465 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-697a75a0-8a0d-414d-a2d3-1dc9b2c03d81 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:29.454870 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-697a75a0-8a0d-414d-a2d3-1dc9b2c03d81 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:29.657972 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0060e4a1-1851-4876-b0f3-225f5cca1289 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:29.667580 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-0060e4a1-1851-4876-b0f3-225f5cca1289 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.252852 Apr 11 16:36:29.669211 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 95/200] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:29 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:29.686291 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-697a75a0-8a0d-414d-a2d3-1dc9b2c03d81 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:29.707003 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-697a75a0-8a0d-414d-a2d3-1dc9b2c03d81 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:29.708634 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-697a75a0-8a0d-414d-a2d3-1dc9b2c03d81 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:29.713753 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-697a75a0-8a0d-414d-a2d3-1dc9b2c03d81 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.269654 Apr 11 16:36:29.730721 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 106/201] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:29 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:30.158392 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-1cff02dc-8e34-4c20-b7f0-6bf012564578 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:30.158980 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-1cff02dc-8e34-4c20-b7f0-6bf012564578 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:30.165936 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1cff02dc-8e34-4c20-b7f0-6bf012564578 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:30.166481 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1cff02dc-8e34-4c20-b7f0-6bf012564578 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:30.167165 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1cff02dc-8e34-4c20-b7f0-6bf012564578 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:30.167782 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1cff02dc-8e34-4c20-b7f0-6bf012564578 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:30.183842 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c100948d-3c3b-4d2e-9c69-0dafad61f9b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:30.184643 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c100948d-3c3b-4d2e-9c69-0dafad61f9b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:30.191086 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c100948d-3c3b-4d2e-9c69-0dafad61f9b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:30.191604 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c100948d-3c3b-4d2e-9c69-0dafad61f9b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:30.192469 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c100948d-3c3b-4d2e-9c69-0dafad61f9b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:30.193166 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c100948d-3c3b-4d2e-9c69-0dafad61f9b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:30.376860 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-1cff02dc-8e34-4c20-b7f0-6bf012564578 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:30.385554 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c100948d-3c3b-4d2e-9c69-0dafad61f9b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:30.390548 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-1cff02dc-8e34-4c20-b7f0-6bf012564578 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.235755 Apr 11 16:36:30.392688 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 96/202] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:30 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:30.393411 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c100948d-3c3b-4d2e-9c69-0dafad61f9b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.213189 Apr 11 16:36:30.394002 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 107/203] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:30 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:30.687387 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-187b098f-60a6-494d-af6a-1e9509b8ad54 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:30.688070 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-187b098f-60a6-494d-af6a-1e9509b8ad54 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:30.698418 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-187b098f-60a6-494d-af6a-1e9509b8ad54 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:30.698869 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-187b098f-60a6-494d-af6a-1e9509b8ad54 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:30.699611 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-187b098f-60a6-494d-af6a-1e9509b8ad54 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:30.700085 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-187b098f-60a6-494d-af6a-1e9509b8ad54 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:30.736040 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-6e1512e6-800e-4883-adb4-d16eecf663db tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:30.736746 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-6e1512e6-800e-4883-adb4-d16eecf663db tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:30.747808 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6e1512e6-800e-4883-adb4-d16eecf663db tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:30.749140 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6e1512e6-800e-4883-adb4-d16eecf663db tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:30.751733 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6e1512e6-800e-4883-adb4-d16eecf663db tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:30.754893 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6e1512e6-800e-4883-adb4-d16eecf663db tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:30.962767 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-187b098f-60a6-494d-af6a-1e9509b8ad54 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:30.971345 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6e1512e6-800e-4883-adb4-d16eecf663db tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:30.971550 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-187b098f-60a6-494d-af6a-1e9509b8ad54 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1315 microversion: 2.1 time: 0.289419 Apr 11 16:36:30.972336 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 97/204] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:30 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:30.982092 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6e1512e6-800e-4883-adb4-d16eecf663db tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:30.983586 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6e1512e6-800e-4883-adb4-d16eecf663db tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:30.984754 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-6e1512e6-800e-4883-adb4-d16eecf663db tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.254096 Apr 11 16:36:30.985339 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 108/205] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:30 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:36:31.409808 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-4b7d671d-fadd-4b37-a539-af7f81a0acbb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:31.410374 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-fe3feb24-958b-4adc-bcb9-049544f5153e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:31.410729 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-4b7d671d-fadd-4b37-a539-af7f81a0acbb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:31.410846 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-fe3feb24-958b-4adc-bcb9-049544f5153e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:31.417374 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fe3feb24-958b-4adc-bcb9-049544f5153e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:31.417818 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fe3feb24-958b-4adc-bcb9-049544f5153e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:31.418105 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4b7d671d-fadd-4b37-a539-af7f81a0acbb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:31.418613 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4b7d671d-fadd-4b37-a539-af7f81a0acbb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:31.418771 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fe3feb24-958b-4adc-bcb9-049544f5153e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:31.419188 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fe3feb24-958b-4adc-bcb9-049544f5153e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:31.419393 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4b7d671d-fadd-4b37-a539-af7f81a0acbb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:31.419885 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4b7d671d-fadd-4b37-a539-af7f81a0acbb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:31.630086 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-4b7d671d-fadd-4b37-a539-af7f81a0acbb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:31.633047 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-fe3feb24-958b-4adc-bcb9-049544f5153e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:31.638876 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-4b7d671d-fadd-4b37-a539-af7f81a0acbb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.232809 Apr 11 16:36:31.639532 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 98/206] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:31 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:31.640831 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-fe3feb24-958b-4adc-bcb9-049544f5153e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.234424 Apr 11 16:36:31.641571 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 109/207] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:31 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:31.961742 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-2dcfd98f-9362-4357-925b-64d3867ceeec req-a885d4d3-5440-4f56-b03d-b840c139e0ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db1c6a9-bc5a-45f7-bbd3-590292385768", "name": "network-vif-plugged", "status": "completed", "tag": "a73169ab-a868-4681-96ea-03b1560d84b4"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:36:31.970599 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-2dcfd98f-9362-4357-925b-64d3867ceeec req-a885d4d3-5440-4f56-b03d-b840c139e0ab service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:31.971036 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-2dcfd98f-9362-4357-925b-64d3867ceeec req-a885d4d3-5440-4f56-b03d-b840c139e0ab service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:31.982850 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-2dcfd98f-9362-4357-925b-64d3867ceeec req-a885d4d3-5440-4f56-b03d-b840c139e0ab service nova] Creating event network-vif-plugged:a73169ab-a868-4681-96ea-03b1560d84b4 for instance 0db1c6a9-bc5a-45f7-bbd3-590292385768 on hv-cinder-83716 Apr 11 16:36:31.989129 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-537ab2c2-6437-4878-827d-88543f01dea4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:31.989757 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-537ab2c2-6437-4878-827d-88543f01dea4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:32.002512 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-537ab2c2-6437-4878-827d-88543f01dea4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:32.002954 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-537ab2c2-6437-4878-827d-88543f01dea4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:32.003796 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-537ab2c2-6437-4878-827d-88543f01dea4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:32.004873 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-537ab2c2-6437-4878-827d-88543f01dea4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:32.005365 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-2dcfd98f-9362-4357-925b-64d3867ceeec req-a885d4d3-5440-4f56-b03d-b840c139e0ab service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045890 Apr 11 16:36:32.009102 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 99/208] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:36:32.017816 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-6c1b1057-98ce-4f0e-ad41-ae562d5d189c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:32.018973 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-6c1b1057-98ce-4f0e-ad41-ae562d5d189c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:32.044235 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6c1b1057-98ce-4f0e-ad41-ae562d5d189c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:32.044680 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6c1b1057-98ce-4f0e-ad41-ae562d5d189c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:32.045465 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6c1b1057-98ce-4f0e-ad41-ae562d5d189c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:32.045886 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6c1b1057-98ce-4f0e-ad41-ae562d5d189c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:32.284077 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-537ab2c2-6437-4878-827d-88543f01dea4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:32.285071 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-6c1b1057-98ce-4f0e-ad41-ae562d5d189c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:32.294736 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-537ab2c2-6437-4878-827d-88543f01dea4 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1502 microversion: 2.1 time: 0.309333 Apr 11 16:36:32.295535 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 110/209] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:31 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1502 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:32.307494 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-6c1b1057-98ce-4f0e-ad41-ae562d5d189c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:32.307494 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-6c1b1057-98ce-4f0e-ad41-ae562d5d189c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:32.307494 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-6c1b1057-98ce-4f0e-ad41-ae562d5d189c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.289726 Apr 11 16:36:32.307984 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 100/210] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:32 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:32.658387 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-37d5de00-da85-41cb-9dca-8f1cdcd32962 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:32.659377 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a6edd16f-63b0-4809-867a-4ed5102d3fe3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:32.659951 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-37d5de00-da85-41cb-9dca-8f1cdcd32962 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:32.660481 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a6edd16f-63b0-4809-867a-4ed5102d3fe3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:32.667038 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-37d5de00-da85-41cb-9dca-8f1cdcd32962 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:32.667742 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-37d5de00-da85-41cb-9dca-8f1cdcd32962 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:32.668672 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-37d5de00-da85-41cb-9dca-8f1cdcd32962 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:32.669355 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-37d5de00-da85-41cb-9dca-8f1cdcd32962 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:32.670732 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a6edd16f-63b0-4809-867a-4ed5102d3fe3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:32.671266 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a6edd16f-63b0-4809-867a-4ed5102d3fe3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:32.672162 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a6edd16f-63b0-4809-867a-4ed5102d3fe3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:32.672670 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a6edd16f-63b0-4809-867a-4ed5102d3fe3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:32.866051 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-37d5de00-da85-41cb-9dca-8f1cdcd32962 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:32.869543 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a6edd16f-63b0-4809-867a-4ed5102d3fe3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:32.875491 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-37d5de00-da85-41cb-9dca-8f1cdcd32962 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.221054 Apr 11 16:36:32.876097 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 111/211] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:32 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:32.885349 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a6edd16f-63b0-4809-867a-4ed5102d3fe3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.233278 Apr 11 16:36:32.886290 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 101/212] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:32 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:33.329372 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-75b1f526-578c-408d-b6b0-df02f8b2d825 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:33.329953 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-75b1f526-578c-408d-b6b0-df02f8b2d825 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:33.336391 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-75b1f526-578c-408d-b6b0-df02f8b2d825 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:33.336829 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-75b1f526-578c-408d-b6b0-df02f8b2d825 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:33.337584 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-75b1f526-578c-408d-b6b0-df02f8b2d825 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:33.338004 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-75b1f526-578c-408d-b6b0-df02f8b2d825 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:33.475172 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-75b1f526-578c-408d-b6b0-df02f8b2d825 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:33.484038 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-75b1f526-578c-408d-b6b0-df02f8b2d825 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:33.485616 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-75b1f526-578c-408d-b6b0-df02f8b2d825 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:33.486647 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-75b1f526-578c-408d-b6b0-df02f8b2d825 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.161242 Apr 11 16:36:33.487206 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 112/213] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:33 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:33.897193 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f376f6dd-395d-4610-b287-f115f97801ad tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:33.897880 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f376f6dd-395d-4610-b287-f115f97801ad tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:33.904425 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f376f6dd-395d-4610-b287-f115f97801ad tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:33.904866 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f376f6dd-395d-4610-b287-f115f97801ad tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:33.905629 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f376f6dd-395d-4610-b287-f115f97801ad tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:33.906055 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f376f6dd-395d-4610-b287-f115f97801ad tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:33.906187 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b44369da-e594-4177-bc4d-9460bd83aa01 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:33.906807 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b44369da-e594-4177-bc4d-9460bd83aa01 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:33.914028 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b44369da-e594-4177-bc4d-9460bd83aa01 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:33.914461 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b44369da-e594-4177-bc4d-9460bd83aa01 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:33.915251 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b44369da-e594-4177-bc4d-9460bd83aa01 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:33.915694 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b44369da-e594-4177-bc4d-9460bd83aa01 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:34.103612 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f376f6dd-395d-4610-b287-f115f97801ad tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:34.113358 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b44369da-e594-4177-bc4d-9460bd83aa01 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:34.114438 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f376f6dd-395d-4610-b287-f115f97801ad tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.220995 Apr 11 16:36:34.115044 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 102/214] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:33 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:34.121985 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b44369da-e594-4177-bc4d-9460bd83aa01 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.219536 Apr 11 16:36:34.122743 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 113/215] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:33 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:34.507519 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d9bdf12d-2f89-4a22-8612-780ff7b01680 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:34.508283 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d9bdf12d-2f89-4a22-8612-780ff7b01680 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:34.514584 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d9bdf12d-2f89-4a22-8612-780ff7b01680 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:34.515055 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d9bdf12d-2f89-4a22-8612-780ff7b01680 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:34.515880 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d9bdf12d-2f89-4a22-8612-780ff7b01680 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:34.516294 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d9bdf12d-2f89-4a22-8612-780ff7b01680 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:34.648261 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d9bdf12d-2f89-4a22-8612-780ff7b01680 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:34.657207 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d9bdf12d-2f89-4a22-8612-780ff7b01680 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:34.658663 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d9bdf12d-2f89-4a22-8612-780ff7b01680 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:34.659803 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d9bdf12d-2f89-4a22-8612-780ff7b01680 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.157399 Apr 11 16:36:34.660369 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 103/216] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:34 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:35.132320 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-5996850a-7d07-4a1c-ad03-1524a6f0b19a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:35.132933 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-5996850a-7d07-4a1c-ad03-1524a6f0b19a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:35.139236 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-bac1f5d5-e7f9-429c-8ec0-ef8a5ca4925a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:35.139710 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5996850a-7d07-4a1c-ad03-1524a6f0b19a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:35.140001 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-bac1f5d5-e7f9-429c-8ec0-ef8a5ca4925a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:35.140150 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5996850a-7d07-4a1c-ad03-1524a6f0b19a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:35.140809 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5996850a-7d07-4a1c-ad03-1524a6f0b19a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:35.141233 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5996850a-7d07-4a1c-ad03-1524a6f0b19a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:35.146500 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bac1f5d5-e7f9-429c-8ec0-ef8a5ca4925a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:35.147042 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bac1f5d5-e7f9-429c-8ec0-ef8a5ca4925a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:35.147884 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bac1f5d5-e7f9-429c-8ec0-ef8a5ca4925a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:35.148491 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bac1f5d5-e7f9-429c-8ec0-ef8a5ca4925a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:35.333306 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5996850a-7d07-4a1c-ad03-1524a6f0b19a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:35.337344 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-bac1f5d5-e7f9-429c-8ec0-ef8a5ca4925a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:35.341622 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-5996850a-7d07-4a1c-ad03-1524a6f0b19a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.213934 Apr 11 16:36:35.342203 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 114/217] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:35 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:35.345291 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-bac1f5d5-e7f9-429c-8ec0-ef8a5ca4925a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.209872 Apr 11 16:36:35.345848 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 104/218] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:35 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:35.678084 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-707dcc08-64f9-42b6-bef8-d00e7ee076c2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:35.678675 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-707dcc08-64f9-42b6-bef8-d00e7ee076c2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:35.684933 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-707dcc08-64f9-42b6-bef8-d00e7ee076c2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:35.685368 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-707dcc08-64f9-42b6-bef8-d00e7ee076c2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:35.686125 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-707dcc08-64f9-42b6-bef8-d00e7ee076c2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:35.686548 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-707dcc08-64f9-42b6-bef8-d00e7ee076c2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:35.824614 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-707dcc08-64f9-42b6-bef8-d00e7ee076c2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:35.832742 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-707dcc08-64f9-42b6-bef8-d00e7ee076c2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:35.834202 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-707dcc08-64f9-42b6-bef8-d00e7ee076c2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:35.835328 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-707dcc08-64f9-42b6-bef8-d00e7ee076c2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.161284 Apr 11 16:36:35.835968 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 115/219] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:35 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:36.360494 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-7378d722-27a6-4293-ba8a-fb0fc31c32b2 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:36.361048 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-aa8b79d2-deef-4365-92bf-da8c69f0fdd0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:36.361541 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-7378d722-27a6-4293-ba8a-fb0fc31c32b2 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:36.361675 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-aa8b79d2-deef-4365-92bf-da8c69f0fdd0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:36.368410 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7378d722-27a6-4293-ba8a-fb0fc31c32b2 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:36.368857 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7378d722-27a6-4293-ba8a-fb0fc31c32b2 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:36.368989 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-aa8b79d2-deef-4365-92bf-da8c69f0fdd0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:36.369412 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-aa8b79d2-deef-4365-92bf-da8c69f0fdd0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:36.369601 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7378d722-27a6-4293-ba8a-fb0fc31c32b2 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:36.370029 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7378d722-27a6-4293-ba8a-fb0fc31c32b2 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:36.370152 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-aa8b79d2-deef-4365-92bf-da8c69f0fdd0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:36.370555 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-aa8b79d2-deef-4365-92bf-da8c69f0fdd0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:36.564770 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-aa8b79d2-deef-4365-92bf-da8c69f0fdd0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:36.568042 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-7378d722-27a6-4293-ba8a-fb0fc31c32b2 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:36.574418 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-aa8b79d2-deef-4365-92bf-da8c69f0fdd0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.216821 Apr 11 16:36:36.575738 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 116/220] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:36 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:36.579042 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-7378d722-27a6-4293-ba8a-fb0fc31c32b2 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.223674 Apr 11 16:36:36.579719 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 105/221] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:36 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:36.854873 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-99dbd7e6-8226-48a5-afdc-209cf51cf71e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:36.855503 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-99dbd7e6-8226-48a5-afdc-209cf51cf71e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:36.862373 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-99dbd7e6-8226-48a5-afdc-209cf51cf71e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:36.862821 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-99dbd7e6-8226-48a5-afdc-209cf51cf71e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:36.863589 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-99dbd7e6-8226-48a5-afdc-209cf51cf71e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:36.864060 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-99dbd7e6-8226-48a5-afdc-209cf51cf71e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:36.998102 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-99dbd7e6-8226-48a5-afdc-209cf51cf71e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:37.007238 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-99dbd7e6-8226-48a5-afdc-209cf51cf71e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:37.008783 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-99dbd7e6-8226-48a5-afdc-209cf51cf71e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:37.009880 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-99dbd7e6-8226-48a5-afdc-209cf51cf71e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.159226 Apr 11 16:36:37.010452 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 117/222] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:36 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:37.592182 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-65cdb657-392c-4cb2-94c7-a9db53894c96 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:37.592804 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-65cdb657-392c-4cb2-94c7-a9db53894c96 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:37.596503 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-86cded93-c0cd-4e11-b2b4-6f266f1348a5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:37.597139 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-86cded93-c0cd-4e11-b2b4-6f266f1348a5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:37.599011 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-65cdb657-392c-4cb2-94c7-a9db53894c96 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:37.599463 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-65cdb657-392c-4cb2-94c7-a9db53894c96 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:37.600258 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-65cdb657-392c-4cb2-94c7-a9db53894c96 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:37.600680 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-65cdb657-392c-4cb2-94c7-a9db53894c96 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:37.603482 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-86cded93-c0cd-4e11-b2b4-6f266f1348a5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:37.603875 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-86cded93-c0cd-4e11-b2b4-6f266f1348a5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:37.604710 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-86cded93-c0cd-4e11-b2b4-6f266f1348a5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:37.605133 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-86cded93-c0cd-4e11-b2b4-6f266f1348a5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:37.800255 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-65cdb657-392c-4cb2-94c7-a9db53894c96 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:37.803585 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-86cded93-c0cd-4e11-b2b4-6f266f1348a5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:37.808112 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-65cdb657-392c-4cb2-94c7-a9db53894c96 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.219740 Apr 11 16:36:37.808712 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 106/223] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:37 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:37.814842 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-86cded93-c0cd-4e11-b2b4-6f266f1348a5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.221269 Apr 11 16:36:37.814842 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 118/224] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:37 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:38.029046 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-40a75e40-b221-4a1b-9bb0-f66e683e9d8e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:38.029644 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-40a75e40-b221-4a1b-9bb0-f66e683e9d8e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:38.036447 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-40a75e40-b221-4a1b-9bb0-f66e683e9d8e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:38.036952 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-40a75e40-b221-4a1b-9bb0-f66e683e9d8e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:38.037737 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-40a75e40-b221-4a1b-9bb0-f66e683e9d8e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:38.038181 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-40a75e40-b221-4a1b-9bb0-f66e683e9d8e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:38.172544 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-40a75e40-b221-4a1b-9bb0-f66e683e9d8e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:38.181381 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-40a75e40-b221-4a1b-9bb0-f66e683e9d8e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:38.182922 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-40a75e40-b221-4a1b-9bb0-f66e683e9d8e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:38.184147 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-40a75e40-b221-4a1b-9bb0-f66e683e9d8e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.159282 Apr 11 16:36:38.184714 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 107/225] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:38 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:36:38.825187 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-5ae1450f-850d-42d9-94aa-c9697311cfd8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:38.825797 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-5ae1450f-850d-42d9-94aa-c9697311cfd8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:38.832412 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5ae1450f-850d-42d9-94aa-c9697311cfd8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:38.832866 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5ae1450f-850d-42d9-94aa-c9697311cfd8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:38.833635 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5ae1450f-850d-42d9-94aa-c9697311cfd8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:38.834063 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5ae1450f-850d-42d9-94aa-c9697311cfd8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:38.835473 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-fb8eae49-06ea-4260-ab51-1714a9203ca0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:38.836212 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-fb8eae49-06ea-4260-ab51-1714a9203ca0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:38.842503 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fb8eae49-06ea-4260-ab51-1714a9203ca0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:38.843066 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fb8eae49-06ea-4260-ab51-1714a9203ca0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:38.843919 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fb8eae49-06ea-4260-ab51-1714a9203ca0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:38.844382 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fb8eae49-06ea-4260-ab51-1714a9203ca0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:39.035260 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5ae1450f-850d-42d9-94aa-c9697311cfd8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:39.039299 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-fb8eae49-06ea-4260-ab51-1714a9203ca0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:39.042339 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-5ae1450f-850d-42d9-94aa-c9697311cfd8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.221023 Apr 11 16:36:39.043017 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 119/226] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:38 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:39.047234 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-fb8eae49-06ea-4260-ab51-1714a9203ca0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.215851 Apr 11 16:36:39.048121 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 108/227] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:38 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:39.202765 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-79032993-5099-4f38-87d3-031aed37398d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:39.203393 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-79032993-5099-4f38-87d3-031aed37398d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:39.211673 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-79032993-5099-4f38-87d3-031aed37398d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:39.212390 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-79032993-5099-4f38-87d3-031aed37398d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:39.213406 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-79032993-5099-4f38-87d3-031aed37398d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:39.214110 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-79032993-5099-4f38-87d3-031aed37398d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:39.355987 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-79032993-5099-4f38-87d3-031aed37398d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:39.363876 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-79032993-5099-4f38-87d3-031aed37398d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:39.365322 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-79032993-5099-4f38-87d3-031aed37398d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:39.366988 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-79032993-5099-4f38-87d3-031aed37398d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.168232 Apr 11 16:36:39.367730 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 120/228] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:39 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:40.059361 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-82f1e652-c29e-4ab9-8a56-331577a730cf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:40.059941 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-82f1e652-c29e-4ab9-8a56-331577a730cf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:40.064281 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-6bdce1e4-a234-46f9-8dd5-9eca267ecebb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:40.064809 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-6bdce1e4-a234-46f9-8dd5-9eca267ecebb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:40.066611 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-82f1e652-c29e-4ab9-8a56-331577a730cf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:40.067050 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-82f1e652-c29e-4ab9-8a56-331577a730cf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:40.067861 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-82f1e652-c29e-4ab9-8a56-331577a730cf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:40.068289 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-82f1e652-c29e-4ab9-8a56-331577a730cf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:40.071424 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6bdce1e4-a234-46f9-8dd5-9eca267ecebb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:40.072052 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6bdce1e4-a234-46f9-8dd5-9eca267ecebb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:40.072827 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6bdce1e4-a234-46f9-8dd5-9eca267ecebb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:40.073277 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6bdce1e4-a234-46f9-8dd5-9eca267ecebb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:40.268158 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-82f1e652-c29e-4ab9-8a56-331577a730cf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:40.272622 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6bdce1e4-a234-46f9-8dd5-9eca267ecebb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:40.282439 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-6bdce1e4-a234-46f9-8dd5-9eca267ecebb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.221723 Apr 11 16:36:40.284228 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-82f1e652-c29e-4ab9-8a56-331577a730cf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.228691 Apr 11 16:36:40.285276 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 121/229] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:40 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:40.286618 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 109/230] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:40 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:40.385793 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ab4b1d70-3f7c-45fd-b1f0-96b80b0f777b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:40.386384 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ab4b1d70-3f7c-45fd-b1f0-96b80b0f777b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:40.392833 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ab4b1d70-3f7c-45fd-b1f0-96b80b0f777b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:40.393266 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ab4b1d70-3f7c-45fd-b1f0-96b80b0f777b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:40.394024 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ab4b1d70-3f7c-45fd-b1f0-96b80b0f777b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:40.394429 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ab4b1d70-3f7c-45fd-b1f0-96b80b0f777b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:40.526179 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ab4b1d70-3f7c-45fd-b1f0-96b80b0f777b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:40.535209 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ab4b1d70-3f7c-45fd-b1f0-96b80b0f777b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:40.536750 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ab4b1d70-3f7c-45fd-b1f0-96b80b0f777b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:40.537901 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ab4b1d70-3f7c-45fd-b1f0-96b80b0f777b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.156306 Apr 11 16:36:40.538477 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 122/231] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:40 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:41.301426 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-dcb610da-8010-46c2-a9fc-cdb6eb297f6d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:41.302045 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-dcb610da-8010-46c2-a9fc-cdb6eb297f6d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:41.302243 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-7332d58c-3440-4425-9e68-942cba82b8bd tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:41.302873 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-7332d58c-3440-4425-9e68-942cba82b8bd tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:41.309187 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dcb610da-8010-46c2-a9fc-cdb6eb297f6d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:41.309358 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7332d58c-3440-4425-9e68-942cba82b8bd tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:41.309657 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dcb610da-8010-46c2-a9fc-cdb6eb297f6d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:41.309790 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7332d58c-3440-4425-9e68-942cba82b8bd tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:41.310424 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7332d58c-3440-4425-9e68-942cba82b8bd tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:41.310559 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dcb610da-8010-46c2-a9fc-cdb6eb297f6d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:41.310834 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dcb610da-8010-46c2-a9fc-cdb6eb297f6d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:41.310933 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7332d58c-3440-4425-9e68-942cba82b8bd tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:41.508494 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-dcb610da-8010-46c2-a9fc-cdb6eb297f6d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:41.513796 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-7332d58c-3440-4425-9e68-942cba82b8bd tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:41.517689 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-dcb610da-8010-46c2-a9fc-cdb6eb297f6d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.220026 Apr 11 16:36:41.518287 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 110/232] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:41 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:41.523103 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-7332d58c-3440-4425-9e68-942cba82b8bd tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.224525 Apr 11 16:36:41.523731 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 123/233] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:41 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:41.556309 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-adaab582-653c-4f9c-a401-702615558ff6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:41.556833 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-adaab582-653c-4f9c-a401-702615558ff6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:41.563062 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-adaab582-653c-4f9c-a401-702615558ff6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:41.563496 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-adaab582-653c-4f9c-a401-702615558ff6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:41.564282 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-adaab582-653c-4f9c-a401-702615558ff6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:41.564709 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-adaab582-653c-4f9c-a401-702615558ff6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:41.695776 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-adaab582-653c-4f9c-a401-702615558ff6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:41.704571 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-adaab582-653c-4f9c-a401-702615558ff6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:41.706059 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-adaab582-653c-4f9c-a401-702615558ff6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:41.707153 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-adaab582-653c-4f9c-a401-702615558ff6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.154859 Apr 11 16:36:41.707756 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 111/234] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:41 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:42.535787 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d68942a0-5373-4377-ad01-b7470eda9f70 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:42.536400 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d68942a0-5373-4377-ad01-b7470eda9f70 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:42.540720 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-90ea54ca-9350-4016-8f29-06120a30050d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:42.541438 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-90ea54ca-9350-4016-8f29-06120a30050d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:42.543263 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d68942a0-5373-4377-ad01-b7470eda9f70 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:42.543742 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d68942a0-5373-4377-ad01-b7470eda9f70 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:42.544505 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d68942a0-5373-4377-ad01-b7470eda9f70 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:42.544924 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d68942a0-5373-4377-ad01-b7470eda9f70 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:42.547720 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-90ea54ca-9350-4016-8f29-06120a30050d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:42.548164 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-90ea54ca-9350-4016-8f29-06120a30050d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:42.548929 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-90ea54ca-9350-4016-8f29-06120a30050d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:42.549349 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-90ea54ca-9350-4016-8f29-06120a30050d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:42.740312 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d68942a0-5373-4377-ad01-b7470eda9f70 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:42.743472 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-90ea54ca-9350-4016-8f29-06120a30050d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:42.748272 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d68942a0-5373-4377-ad01-b7470eda9f70 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.216420 Apr 11 16:36:42.748952 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 124/235] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:42 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:42.751267 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-90ea54ca-9350-4016-8f29-06120a30050d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.214600 Apr 11 16:36:42.752188 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 112/236] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:42 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:42.753957 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-84ab76e6-3d42-45a3-809b-b933c9d15bcb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:42.754991 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-84ab76e6-3d42-45a3-809b-b933c9d15bcb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:42.761976 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-84ab76e6-3d42-45a3-809b-b933c9d15bcb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:42.762414 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-84ab76e6-3d42-45a3-809b-b933c9d15bcb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:42.763181 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-84ab76e6-3d42-45a3-809b-b933c9d15bcb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:42.763602 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-84ab76e6-3d42-45a3-809b-b933c9d15bcb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:42.897994 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-84ab76e6-3d42-45a3-809b-b933c9d15bcb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:42.906152 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-84ab76e6-3d42-45a3-809b-b933c9d15bcb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:42.907666 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-84ab76e6-3d42-45a3-809b-b933c9d15bcb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:42.908759 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-84ab76e6-3d42-45a3-809b-b933c9d15bcb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.158833 Apr 11 16:36:42.909327 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 125/237] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:42 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:43.766166 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-fec332fd-a237-4bea-a3d2-568f8f01961f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:43.767073 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-fec332fd-a237-4bea-a3d2-568f8f01961f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:43.768300 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f45756f7-3f19-4698-b89b-89d1b247bd7e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:43.768905 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f45756f7-3f19-4698-b89b-89d1b247bd7e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:43.774151 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fec332fd-a237-4bea-a3d2-568f8f01961f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:43.774712 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fec332fd-a237-4bea-a3d2-568f8f01961f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:43.775497 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fec332fd-a237-4bea-a3d2-568f8f01961f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:43.775823 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f45756f7-3f19-4698-b89b-89d1b247bd7e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:43.775951 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fec332fd-a237-4bea-a3d2-568f8f01961f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:43.776273 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f45756f7-3f19-4698-b89b-89d1b247bd7e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:43.777045 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f45756f7-3f19-4698-b89b-89d1b247bd7e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:43.777473 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f45756f7-3f19-4698-b89b-89d1b247bd7e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:43.969738 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-fec332fd-a237-4bea-a3d2-568f8f01961f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:43.977233 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f45756f7-3f19-4698-b89b-89d1b247bd7e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:43.978213 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-fec332fd-a237-4bea-a3d2-568f8f01961f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.216027 Apr 11 16:36:43.987572 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 113/238] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:43 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:43.987572 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-0d9c2dee-8698-481b-a689-7cb0bc84e287 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:43.987572 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-0d9c2dee-8698-481b-a689-7cb0bc84e287 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:43.990642 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0d9c2dee-8698-481b-a689-7cb0bc84e287 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:43.991201 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0d9c2dee-8698-481b-a689-7cb0bc84e287 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:43.991995 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0d9c2dee-8698-481b-a689-7cb0bc84e287 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:43.992423 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0d9c2dee-8698-481b-a689-7cb0bc84e287 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:44.000514 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f45756f7-3f19-4698-b89b-89d1b247bd7e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.235935 Apr 11 16:36:44.001315 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 126/239] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:43 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:44.124757 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0d9c2dee-8698-481b-a689-7cb0bc84e287 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:44.133749 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0d9c2dee-8698-481b-a689-7cb0bc84e287 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:44.135994 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0d9c2dee-8698-481b-a689-7cb0bc84e287 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:44.137097 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-0d9c2dee-8698-481b-a689-7cb0bc84e287 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1405 microversion: 2.20 time: 0.157184 Apr 11 16:36:44.139339 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 114/240] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:43 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:44.994840 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-40566961-24ff-4511-aaf7-34937046b437 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:44.995462 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-40566961-24ff-4511-aaf7-34937046b437 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:45.001720 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-40566961-24ff-4511-aaf7-34937046b437 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:45.002161 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-40566961-24ff-4511-aaf7-34937046b437 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:45.002956 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-40566961-24ff-4511-aaf7-34937046b437 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:45.003375 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-40566961-24ff-4511-aaf7-34937046b437 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:45.018187 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-3bb070f2-69d3-4862-97e9-4f3ebe15b6b8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:45.019428 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-3bb070f2-69d3-4862-97e9-4f3ebe15b6b8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:45.026009 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3bb070f2-69d3-4862-97e9-4f3ebe15b6b8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:45.026479 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3bb070f2-69d3-4862-97e9-4f3ebe15b6b8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:45.029790 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3bb070f2-69d3-4862-97e9-4f3ebe15b6b8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:45.030249 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3bb070f2-69d3-4862-97e9-4f3ebe15b6b8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:45.211248 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-40566961-24ff-4511-aaf7-34937046b437 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:45.215338 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-3bb070f2-69d3-4862-97e9-4f3ebe15b6b8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:45.221190 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-40566961-24ff-4511-aaf7-34937046b437 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.229834 Apr 11 16:36:45.226014 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 127/241] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:44 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:45.229893 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-3bb070f2-69d3-4862-97e9-4f3ebe15b6b8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.215831 Apr 11 16:36:45.231740 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 115/242] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:45 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:45.234568 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-df7c701d-902d-4e4d-bd32-92dfb531b647 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:45.235138 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-df7c701d-902d-4e4d-bd32-92dfb531b647 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:45.241233 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-df7c701d-902d-4e4d-bd32-92dfb531b647 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:45.241651 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-df7c701d-902d-4e4d-bd32-92dfb531b647 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:45.242469 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-df7c701d-902d-4e4d-bd32-92dfb531b647 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:45.242909 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-df7c701d-902d-4e4d-bd32-92dfb531b647 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:45.370835 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-df7c701d-902d-4e4d-bd32-92dfb531b647 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:45.378898 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-df7c701d-902d-4e4d-bd32-92dfb531b647 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:45.381065 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-df7c701d-902d-4e4d-bd32-92dfb531b647 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:45.382218 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-df7c701d-902d-4e4d-bd32-92dfb531b647 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1597 microversion: 2.20 time: 0.155023 Apr 11 16:36:45.382784 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 128/243] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:36:45 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1597 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:36:45.401185 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e174375f-93d1-4397-86c2-1768ff9a0848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:45.401664 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e174375f-93d1-4397-86c2-1768ff9a0848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:45.408290 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e174375f-93d1-4397-86c2-1768ff9a0848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:45.408729 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e174375f-93d1-4397-86c2-1768ff9a0848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:45.409494 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e174375f-93d1-4397-86c2-1768ff9a0848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:45.409920 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e174375f-93d1-4397-86c2-1768ff9a0848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:45.526968 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e174375f-93d1-4397-86c2-1768ff9a0848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.129849 Apr 11 16:36:45.527450 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 116/244] 10.222.0.65 () {60 vars in 1315 bytes} [Mon Apr 11 16:36:45 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 16:36:46.239180 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-21c4ce8b-54db-47ab-9be8-c35a987c7ef4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:46.241306 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-21c4ce8b-54db-47ab-9be8-c35a987c7ef4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:46.247097 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-3481d5d1-6184-4c57-a147-6c5b9d1ba3a0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:46.248159 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-3481d5d1-6184-4c57-a147-6c5b9d1ba3a0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:46.254786 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-21c4ce8b-54db-47ab-9be8-c35a987c7ef4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:46.254989 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3481d5d1-6184-4c57-a147-6c5b9d1ba3a0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:46.255300 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-21c4ce8b-54db-47ab-9be8-c35a987c7ef4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:46.255529 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3481d5d1-6184-4c57-a147-6c5b9d1ba3a0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:46.256161 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-21c4ce8b-54db-47ab-9be8-c35a987c7ef4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:46.256459 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3481d5d1-6184-4c57-a147-6c5b9d1ba3a0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:46.256562 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-21c4ce8b-54db-47ab-9be8-c35a987c7ef4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:46.256989 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3481d5d1-6184-4c57-a147-6c5b9d1ba3a0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:46.880315 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-3481d5d1-6184-4c57-a147-6c5b9d1ba3a0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:46.888400 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-3481d5d1-6184-4c57-a147-6c5b9d1ba3a0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.645706 Apr 11 16:36:46.888928 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 117/245] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:46 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:46.906459 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-21c4ce8b-54db-47ab-9be8-c35a987c7ef4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:46.914318 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-21c4ce8b-54db-47ab-9be8-c35a987c7ef4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.679672 Apr 11 16:36:46.915141 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 129/246] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:46 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:47.415086 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-f290474d-e3e3-405e-8317-8113f3e41412 req-8eea0eb1-040d-4595-a3d6-5f245e235cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f08685e5-3c41-4032-9633-cc591711221a", "tag": "8b85453b-0363-47d5-9902-93d848d7263e"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:36:47.423228 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-f290474d-e3e3-405e-8317-8113f3e41412 req-8eea0eb1-040d-4595-a3d6-5f245e235cd4 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:47.424210 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-f290474d-e3e3-405e-8317-8113f3e41412 req-8eea0eb1-040d-4595-a3d6-5f245e235cd4 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:47.434944 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-f290474d-e3e3-405e-8317-8113f3e41412 req-8eea0eb1-040d-4595-a3d6-5f245e235cd4 service nova] Creating event network-changed:8b85453b-0363-47d5-9902-93d848d7263e for instance f08685e5-3c41-4032-9633-cc591711221a on hv-cinder-83716 Apr 11 16:36:47.440053 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-f290474d-e3e3-405e-8317-8113f3e41412 req-8eea0eb1-040d-4595-a3d6-5f245e235cd4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028821 Apr 11 16:36:47.440714 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 118/247] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:36:47.904355 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-58d82962-90be-4e94-b1a1-41d37c3a63b4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:47.904956 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-58d82962-90be-4e94-b1a1-41d37c3a63b4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:47.911266 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-58d82962-90be-4e94-b1a1-41d37c3a63b4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:47.911816 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-58d82962-90be-4e94-b1a1-41d37c3a63b4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:47.912621 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-58d82962-90be-4e94-b1a1-41d37c3a63b4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:47.913039 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-58d82962-90be-4e94-b1a1-41d37c3a63b4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:47.932581 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-84426a4b-3253-4259-9392-30a89ea1b5a5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:47.933264 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-84426a4b-3253-4259-9392-30a89ea1b5a5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:47.942073 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-84426a4b-3253-4259-9392-30a89ea1b5a5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:47.942480 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-84426a4b-3253-4259-9392-30a89ea1b5a5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:47.943801 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-84426a4b-3253-4259-9392-30a89ea1b5a5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:47.944230 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-84426a4b-3253-4259-9392-30a89ea1b5a5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:48.095627 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-58d82962-90be-4e94-b1a1-41d37c3a63b4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:48.103989 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-58d82962-90be-4e94-b1a1-41d37c3a63b4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.203433 Apr 11 16:36:48.104603 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 130/248] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:47 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:48.131298 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-84426a4b-3253-4259-9392-30a89ea1b5a5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:48.142118 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-84426a4b-3253-4259-9392-30a89ea1b5a5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.213808 Apr 11 16:36:48.142721 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 119/249] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:47 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:49.121134 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-2d548b71-e02e-43e2-ae77-4df09b0c4cfa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:49.121758 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-2d548b71-e02e-43e2-ae77-4df09b0c4cfa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:49.128256 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2d548b71-e02e-43e2-ae77-4df09b0c4cfa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:49.128701 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2d548b71-e02e-43e2-ae77-4df09b0c4cfa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:49.129806 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2d548b71-e02e-43e2-ae77-4df09b0c4cfa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:49.130230 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2d548b71-e02e-43e2-ae77-4df09b0c4cfa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:49.158496 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-60872890-e492-4947-8adc-ff85471cce09 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:49.159120 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-60872890-e492-4947-8adc-ff85471cce09 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:49.165942 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-60872890-e492-4947-8adc-ff85471cce09 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:49.166381 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-60872890-e492-4947-8adc-ff85471cce09 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:49.167145 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-60872890-e492-4947-8adc-ff85471cce09 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:49.167567 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-60872890-e492-4947-8adc-ff85471cce09 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:49.314805 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-2d548b71-e02e-43e2-ae77-4df09b0c4cfa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:49.322431 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-2d548b71-e02e-43e2-ae77-4df09b0c4cfa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.205255 Apr 11 16:36:49.323094 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 131/250] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:49 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:49.340575 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-60872890-e492-4947-8adc-ff85471cce09 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:49.348261 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-60872890-e492-4947-8adc-ff85471cce09 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.193636 Apr 11 16:36:49.348829 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 120/251] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:49 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:50.339749 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-9d37fa40-fa03-4441-bce7-940041ee8e07 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:50.340296 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-9d37fa40-fa03-4441-bce7-940041ee8e07 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:50.346576 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9d37fa40-fa03-4441-bce7-940041ee8e07 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:50.347013 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9d37fa40-fa03-4441-bce7-940041ee8e07 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:50.347809 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9d37fa40-fa03-4441-bce7-940041ee8e07 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:50.348230 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9d37fa40-fa03-4441-bce7-940041ee8e07 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:50.365055 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-dc799c5a-a7a2-4038-8fa4-2861b42c6da6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:50.365659 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-dc799c5a-a7a2-4038-8fa4-2861b42c6da6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:50.372052 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dc799c5a-a7a2-4038-8fa4-2861b42c6da6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:50.372493 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dc799c5a-a7a2-4038-8fa4-2861b42c6da6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:50.373257 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dc799c5a-a7a2-4038-8fa4-2861b42c6da6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:50.373684 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dc799c5a-a7a2-4038-8fa4-2861b42c6da6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:50.546712 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9d37fa40-fa03-4441-bce7-940041ee8e07 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:50.554018 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-9d37fa40-fa03-4441-bce7-940041ee8e07 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.218299 Apr 11 16:36:50.557476 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-dc799c5a-a7a2-4038-8fa4-2861b42c6da6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:50.559775 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 132/252] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:50 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:50.565540 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-dc799c5a-a7a2-4038-8fa4-2861b42c6da6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.204287 Apr 11 16:36:50.566129 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 121/253] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:50 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:51.570467 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-5a8eaeef-b851-4f6f-8ae6-702f57447d12 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:51.571506 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-5a8eaeef-b851-4f6f-8ae6-702f57447d12 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:51.580421 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5a8eaeef-b851-4f6f-8ae6-702f57447d12 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:51.581927 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5a8eaeef-b851-4f6f-8ae6-702f57447d12 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:51.584605 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-9d655b3a-af5b-49a2-8081-e9ccd7403123 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:51.586393 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-9d655b3a-af5b-49a2-8081-e9ccd7403123 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:51.589882 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5a8eaeef-b851-4f6f-8ae6-702f57447d12 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:51.590455 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5a8eaeef-b851-4f6f-8ae6-702f57447d12 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:51.595904 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9d655b3a-af5b-49a2-8081-e9ccd7403123 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:51.596705 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9d655b3a-af5b-49a2-8081-e9ccd7403123 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:51.597568 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9d655b3a-af5b-49a2-8081-e9ccd7403123 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:51.598065 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9d655b3a-af5b-49a2-8081-e9ccd7403123 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:51.778669 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5a8eaeef-b851-4f6f-8ae6-702f57447d12 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:51.786493 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-5a8eaeef-b851-4f6f-8ae6-702f57447d12 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1322 microversion: 2.1 time: 0.219888 Apr 11 16:36:51.787110 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 133/254] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:51 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:51.790914 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-9d655b3a-af5b-49a2-8081-e9ccd7403123 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:51.800275 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-9d655b3a-af5b-49a2-8081-e9ccd7403123 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.220975 Apr 11 16:36:51.800934 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 122/255] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:51 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:52.803526 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-e37b9def-39b4-4115-b9cf-8ffcabf6bc84 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:52.804142 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-e37b9def-39b4-4115-b9cf-8ffcabf6bc84 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:52.810456 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e37b9def-39b4-4115-b9cf-8ffcabf6bc84 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:52.810898 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e37b9def-39b4-4115-b9cf-8ffcabf6bc84 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:52.811706 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e37b9def-39b4-4115-b9cf-8ffcabf6bc84 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:52.812134 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e37b9def-39b4-4115-b9cf-8ffcabf6bc84 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:52.817865 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-6dc80da4-f31c-490f-89a8-3db628076440 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:52.818530 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-6dc80da4-f31c-490f-89a8-3db628076440 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:52.825043 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6dc80da4-f31c-490f-89a8-3db628076440 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:52.825529 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6dc80da4-f31c-490f-89a8-3db628076440 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:52.826392 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6dc80da4-f31c-490f-89a8-3db628076440 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:52.826919 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6dc80da4-f31c-490f-89a8-3db628076440 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:53.031625 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-e37b9def-39b4-4115-b9cf-8ffcabf6bc84 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:53.043474 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-6dc80da4-f31c-490f-89a8-3db628076440 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:53.051449 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-6dc80da4-f31c-490f-89a8-3db628076440 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.237688 Apr 11 16:36:53.052077 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 123/256] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:52 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:53.057798 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-e37b9def-39b4-4115-b9cf-8ffcabf6bc84 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1515 microversion: 2.1 time: 0.257930 Apr 11 16:36:53.070725 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 134/257] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:52 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1515 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:53.075075 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-2cc30313-647d-4a7c-88a3-a3af557b3965 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:36:53.076367 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-2cc30313-647d-4a7c-88a3-a3af557b3965 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:53.082561 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2cc30313-647d-4a7c-88a3-a3af557b3965 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:53.083083 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2cc30313-647d-4a7c-88a3-a3af557b3965 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:53.083956 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2cc30313-647d-4a7c-88a3-a3af557b3965 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:53.084447 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2cc30313-647d-4a7c-88a3-a3af557b3965 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:53.108997 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.objects.instance [None req-2cc30313-647d-4a7c-88a3-a3af557b3965 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lazy-loading 'flavor' on Instance uuid 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c {{(pid=123774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:36:53.226641 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-2cc30313-647d-4a7c-88a3-a3af557b3965 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "POST /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c/action" status: 200 len: 32 microversion: 2.1 time: 0.155911 Apr 11 16:36:53.227932 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 124/258] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Apr 11 16:36:53 2022] POST /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 11 16:36:53.236458 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-26b935af-fd23-4957-87f2-d9354b452eae tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:53.237325 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-26b935af-fd23-4957-87f2-d9354b452eae tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:53.247893 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-26b935af-fd23-4957-87f2-d9354b452eae tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:53.248412 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-26b935af-fd23-4957-87f2-d9354b452eae tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:53.249978 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-26b935af-fd23-4957-87f2-d9354b452eae tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:53.250642 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-26b935af-fd23-4957-87f2-d9354b452eae tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:53.388073 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-26b935af-fd23-4957-87f2-d9354b452eae tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:53.395764 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-26b935af-fd23-4957-87f2-d9354b452eae tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.163100 Apr 11 16:36:53.396358 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 135/259] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:53 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:53.694367 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-fc259eb4-1f42-47a7-a617-19ca42bc7442 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6481f5c3-4069-4ddf-91aa-3fba61ef852a"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:36:53.695597 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-fc259eb4-1f42-47a7-a617-19ca42bc7442 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:53.701799 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fc259eb4-1f42-47a7-a617-19ca42bc7442 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:53.702229 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fc259eb4-1f42-47a7-a617-19ca42bc7442 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:53.703000 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fc259eb4-1f42-47a7-a617-19ca42bc7442 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:53.703429 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fc259eb4-1f42-47a7-a617-19ca42bc7442 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:54.071449 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-4a2c1484-53fb-4958-b1a1-489390387323 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:54.072384 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-4a2c1484-53fb-4958-b1a1-489390387323 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:54.081271 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4a2c1484-53fb-4958-b1a1-489390387323 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:54.081806 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4a2c1484-53fb-4958-b1a1-489390387323 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:54.082476 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4a2c1484-53fb-4958-b1a1-489390387323 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:54.082902 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4a2c1484-53fb-4958-b1a1-489390387323 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:54.176536 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-fc259eb4-1f42-47a7-a617-19ca42bc7442 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "POST /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.486165 Apr 11 16:36:54.182703 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 125/260] 10.222.0.65 () {60 vars in 1322 bytes} [Mon Apr 11 16:36:53 2022] POST /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0/os-volume_attachments => generated 194 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:36:54.329684 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-4a2c1484-53fb-4958-b1a1-489390387323 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:54.337811 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-4a2c1484-53fb-4958-b1a1-489390387323 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1363 microversion: 2.1 time: 0.272978 Apr 11 16:36:54.338393 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 136/261] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:54 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:54.416573 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c8ce0a8e-75e0-464c-b652-19829c9d0839 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:54.417269 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c8ce0a8e-75e0-464c-b652-19829c9d0839 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:54.424433 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c8ce0a8e-75e0-464c-b652-19829c9d0839 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:54.424880 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c8ce0a8e-75e0-464c-b652-19829c9d0839 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:54.425664 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c8ce0a8e-75e0-464c-b652-19829c9d0839 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:54.426091 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c8ce0a8e-75e0-464c-b652-19829c9d0839 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:54.744260 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c8ce0a8e-75e0-464c-b652-19829c9d0839 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:54.754442 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c8ce0a8e-75e0-464c-b652-19829c9d0839 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.344268 Apr 11 16:36:54.755259 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 126/262] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:54 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:55.362958 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-6b642514-1398-44a3-b8b8-9e72af063c74 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:55.364967 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-6b642514-1398-44a3-b8b8-9e72af063c74 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:55.374017 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6b642514-1398-44a3-b8b8-9e72af063c74 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:55.374816 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6b642514-1398-44a3-b8b8-9e72af063c74 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:55.376352 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6b642514-1398-44a3-b8b8-9e72af063c74 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:55.386371 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6b642514-1398-44a3-b8b8-9e72af063c74 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:55.590972 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6b642514-1398-44a3-b8b8-9e72af063c74 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:55.599121 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-6b642514-1398-44a3-b8b8-9e72af063c74 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1550 microversion: 2.1 time: 0.245428 Apr 11 16:36:55.599730 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 137/263] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:55 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1550 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:55.616392 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-4126171f-289e-466a-9650-364542f7779d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:55.616879 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-4126171f-289e-466a-9650-364542f7779d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:55.629108 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4126171f-289e-466a-9650-364542f7779d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:55.629711 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4126171f-289e-466a-9650-364542f7779d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:55.630488 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4126171f-289e-466a-9650-364542f7779d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:55.630914 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4126171f-289e-466a-9650-364542f7779d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:55.715847 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-4126171f-289e-466a-9650-364542f7779d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101388 Apr 11 16:36:55.715847 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 127/264] 10.222.0.65 () {58 vars in 1274 bytes} [Mon Apr 11 16:36:55 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:36:55.772004 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1f97723a-5980-4203-b3f2-ba4fd7f39795 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:55.772814 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1f97723a-5980-4203-b3f2-ba4fd7f39795 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:55.779818 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1f97723a-5980-4203-b3f2-ba4fd7f39795 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:55.780257 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1f97723a-5980-4203-b3f2-ba4fd7f39795 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:55.781284 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1f97723a-5980-4203-b3f2-ba4fd7f39795 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:55.781864 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1f97723a-5980-4203-b3f2-ba4fd7f39795 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:56.021588 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1f97723a-5980-4203-b3f2-ba4fd7f39795 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:56.034011 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1f97723a-5980-4203-b3f2-ba4fd7f39795 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.265686 Apr 11 16:36:56.034321 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 138/265] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:55 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:56.827444 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-03f8d657-6650-45e3-bdfd-e3eb7d803097 req-e908849a-3277-4687-b703-4e046a995458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0db1c6a9-bc5a-45f7-bbd3-590292385768", "tag": "a73169ab-a868-4681-96ea-03b1560d84b4"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:36:56.845059 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-03f8d657-6650-45e3-bdfd-e3eb7d803097 req-e908849a-3277-4687-b703-4e046a995458 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:56.845609 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-03f8d657-6650-45e3-bdfd-e3eb7d803097 req-e908849a-3277-4687-b703-4e046a995458 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:56.858175 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-03f8d657-6650-45e3-bdfd-e3eb7d803097 req-e908849a-3277-4687-b703-4e046a995458 service nova] Creating event network-changed:a73169ab-a868-4681-96ea-03b1560d84b4 for instance 0db1c6a9-bc5a-45f7-bbd3-590292385768 on hv-cinder-83716 Apr 11 16:36:56.863879 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-03f8d657-6650-45e3-bdfd-e3eb7d803097 req-e908849a-3277-4687-b703-4e046a995458 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040668 Apr 11 16:36:56.864800 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 128/266] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:36:57.070351 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-5f5ed637-e292-4ff1-a773-47c66aaaff09 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:57.073168 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-5f5ed637-e292-4ff1-a773-47c66aaaff09 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:57.081308 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5f5ed637-e292-4ff1-a773-47c66aaaff09 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:57.081777 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5f5ed637-e292-4ff1-a773-47c66aaaff09 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:57.082554 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5f5ed637-e292-4ff1-a773-47c66aaaff09 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:57.083029 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5f5ed637-e292-4ff1-a773-47c66aaaff09 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:57.630666 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5f5ed637-e292-4ff1-a773-47c66aaaff09 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:57.648218 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-5f5ed637-e292-4ff1-a773-47c66aaaff09 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.598328 Apr 11 16:36:57.651940 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 139/267] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:57 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:58.671820 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-63488a14-88ad-4e96-80cb-9996d4313d23 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:58.672568 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-63488a14-88ad-4e96-80cb-9996d4313d23 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:58.678800 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-63488a14-88ad-4e96-80cb-9996d4313d23 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:58.679311 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-63488a14-88ad-4e96-80cb-9996d4313d23 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:58.680356 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-63488a14-88ad-4e96-80cb-9996d4313d23 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:58.680818 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-63488a14-88ad-4e96-80cb-9996d4313d23 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:58.826427 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-63488a14-88ad-4e96-80cb-9996d4313d23 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:58.834048 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-63488a14-88ad-4e96-80cb-9996d4313d23 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.167224 Apr 11 16:36:58.834634 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 129/268] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:58 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:59.852586 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-cd21b56b-08a7-428a-a99d-0b69c227565c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:36:59.853257 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-cd21b56b-08a7-428a-a99d-0b69c227565c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:36:59.859201 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cd21b56b-08a7-428a-a99d-0b69c227565c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:59.859770 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cd21b56b-08a7-428a-a99d-0b69c227565c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:59.860606 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cd21b56b-08a7-428a-a99d-0b69c227565c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:36:59.861100 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cd21b56b-08a7-428a-a99d-0b69c227565c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:36:59.989949 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-cd21b56b-08a7-428a-a99d-0b69c227565c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:36:59.997712 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-cd21b56b-08a7-428a-a99d-0b69c227565c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.150139 Apr 11 16:36:59.998286 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 140/269] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:36:59 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:01.014642 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-cf48aa48-6293-4f82-8926-fbae46b4a71a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:01.015200 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-cf48aa48-6293-4f82-8926-fbae46b4a71a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:01.021983 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-cf48aa48-6293-4f82-8926-fbae46b4a71a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:01.022428 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-cf48aa48-6293-4f82-8926-fbae46b4a71a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:01.023186 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-cf48aa48-6293-4f82-8926-fbae46b4a71a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:01.023862 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-cf48aa48-6293-4f82-8926-fbae46b4a71a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:01.163928 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-cf48aa48-6293-4f82-8926-fbae46b4a71a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:01.171771 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-cf48aa48-6293-4f82-8926-fbae46b4a71a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.160997 Apr 11 16:37:01.172325 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 130/270] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:01 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:02.188718 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f7185d0e-16c9-4137-b7fe-286cc448d5b9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:02.189492 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f7185d0e-16c9-4137-b7fe-286cc448d5b9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:02.196459 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f7185d0e-16c9-4137-b7fe-286cc448d5b9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:02.196894 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f7185d0e-16c9-4137-b7fe-286cc448d5b9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:02.197635 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f7185d0e-16c9-4137-b7fe-286cc448d5b9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:02.198051 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f7185d0e-16c9-4137-b7fe-286cc448d5b9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:02.328835 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f7185d0e-16c9-4137-b7fe-286cc448d5b9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:02.336935 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f7185d0e-16c9-4137-b7fe-286cc448d5b9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.152055 Apr 11 16:37:02.337516 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 141/271] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:02 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:03.354988 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-57c603f5-4c1a-422f-8908-4164f2cf89d5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:03.355549 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-57c603f5-4c1a-422f-8908-4164f2cf89d5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:03.362501 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-57c603f5-4c1a-422f-8908-4164f2cf89d5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:03.362935 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-57c603f5-4c1a-422f-8908-4164f2cf89d5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:03.363753 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-57c603f5-4c1a-422f-8908-4164f2cf89d5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:03.364183 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-57c603f5-4c1a-422f-8908-4164f2cf89d5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:03.498200 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-57c603f5-4c1a-422f-8908-4164f2cf89d5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:03.506436 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-57c603f5-4c1a-422f-8908-4164f2cf89d5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.155609 Apr 11 16:37:03.507018 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 131/272] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:03 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:04.524168 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d56745e9-59da-4fdc-bba4-f84d4f2758f7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:04.524778 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d56745e9-59da-4fdc-bba4-f84d4f2758f7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:04.531042 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d56745e9-59da-4fdc-bba4-f84d4f2758f7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:04.531480 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d56745e9-59da-4fdc-bba4-f84d4f2758f7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:04.532273 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d56745e9-59da-4fdc-bba4-f84d4f2758f7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:04.532829 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d56745e9-59da-4fdc-bba4-f84d4f2758f7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:04.665984 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d56745e9-59da-4fdc-bba4-f84d4f2758f7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:04.673872 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d56745e9-59da-4fdc-bba4-f84d4f2758f7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.153944 Apr 11 16:37:04.674446 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 142/273] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:04 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:05.691327 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-cb12d8f4-b226-4449-af8c-761e66401f78 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:05.691924 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-cb12d8f4-b226-4449-af8c-761e66401f78 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:05.698665 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-cb12d8f4-b226-4449-af8c-761e66401f78 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:05.699112 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-cb12d8f4-b226-4449-af8c-761e66401f78 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:05.699891 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-cb12d8f4-b226-4449-af8c-761e66401f78 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:05.700354 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-cb12d8f4-b226-4449-af8c-761e66401f78 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:05.832126 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-cb12d8f4-b226-4449-af8c-761e66401f78 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:05.839963 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-cb12d8f4-b226-4449-af8c-761e66401f78 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.152683 Apr 11 16:37:05.840557 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 132/274] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:05 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:06.857028 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c389c36b-b687-450d-a489-72b2e6e8abf3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:06.857560 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c389c36b-b687-450d-a489-72b2e6e8abf3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:06.864072 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c389c36b-b687-450d-a489-72b2e6e8abf3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:06.864473 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c389c36b-b687-450d-a489-72b2e6e8abf3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:06.865255 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c389c36b-b687-450d-a489-72b2e6e8abf3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:06.865676 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c389c36b-b687-450d-a489-72b2e6e8abf3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:06.996565 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c389c36b-b687-450d-a489-72b2e6e8abf3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:07.004339 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c389c36b-b687-450d-a489-72b2e6e8abf3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.151295 Apr 11 16:37:07.004902 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 143/275] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:06 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:08.021210 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-baf8c465-5f06-4297-80cf-5e5b6235ab8d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:08.021941 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-baf8c465-5f06-4297-80cf-5e5b6235ab8d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:08.028857 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-baf8c465-5f06-4297-80cf-5e5b6235ab8d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:08.029301 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-baf8c465-5f06-4297-80cf-5e5b6235ab8d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:08.030192 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-baf8c465-5f06-4297-80cf-5e5b6235ab8d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:08.030634 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-baf8c465-5f06-4297-80cf-5e5b6235ab8d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:08.170371 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-baf8c465-5f06-4297-80cf-5e5b6235ab8d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:08.179035 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-baf8c465-5f06-4297-80cf-5e5b6235ab8d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.161586 Apr 11 16:37:08.185482 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 133/276] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:08 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:09.102446 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-9f72b92e-0d86-40ff-b4d0-c710d34c7161 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:09.102951 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-9f72b92e-0d86-40ff-b4d0-c710d34c7161 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:09.109390 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9f72b92e-0d86-40ff-b4d0-c710d34c7161 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:09.109836 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9f72b92e-0d86-40ff-b4d0-c710d34c7161 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:09.110592 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9f72b92e-0d86-40ff-b4d0-c710d34c7161 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:09.111016 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9f72b92e-0d86-40ff-b4d0-c710d34c7161 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:09.136219 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-9f72b92e-0d86-40ff-b4d0-c710d34c7161 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Going to try to terminate instance {{(pid=123773) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:37:09.196818 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-bde390cf-216f-40da-a80d-db050b076e81 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:09.197431 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-bde390cf-216f-40da-a80d-db050b076e81 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:09.204187 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bde390cf-216f-40da-a80d-db050b076e81 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:09.204627 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bde390cf-216f-40da-a80d-db050b076e81 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:09.205382 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bde390cf-216f-40da-a80d-db050b076e81 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:09.205803 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bde390cf-216f-40da-a80d-db050b076e81 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:09.268252 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-9f72b92e-0d86-40ff-b4d0-c710d34c7161 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 204 len: 0 microversion: 2.1 time: 0.169494 Apr 11 16:37:09.268907 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 144/277] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:37:09 2022] DELETE /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:09.277717 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b9552cc7-60f5-4569-bd84-3ca7c9b28f32 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:09.278378 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b9552cc7-60f5-4569-bd84-3ca7c9b28f32 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:09.284921 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b9552cc7-60f5-4569-bd84-3ca7c9b28f32 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:09.285401 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b9552cc7-60f5-4569-bd84-3ca7c9b28f32 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:09.286179 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b9552cc7-60f5-4569-bd84-3ca7c9b28f32 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:09.286609 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b9552cc7-60f5-4569-bd84-3ca7c9b28f32 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:09.372344 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-bde390cf-216f-40da-a80d-db050b076e81 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:09.380395 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-bde390cf-216f-40da-a80d-db050b076e81 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.187474 Apr 11 16:37:09.381073 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 134/278] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:09 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:09.436019 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b9552cc7-60f5-4569-bd84-3ca7c9b28f32 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:09.444443 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b9552cc7-60f5-4569-bd84-3ca7c9b28f32 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1554 microversion: 2.1 time: 0.170969 Apr 11 16:37:09.445012 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 145/279] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:09 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:10.396967 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-4a63a35d-24b1-420b-a8ee-dc476bc8cf15 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:10.397510 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-4a63a35d-24b1-420b-a8ee-dc476bc8cf15 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:10.405319 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4a63a35d-24b1-420b-a8ee-dc476bc8cf15 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:10.405761 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4a63a35d-24b1-420b-a8ee-dc476bc8cf15 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:10.406512 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4a63a35d-24b1-420b-a8ee-dc476bc8cf15 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:10.406932 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4a63a35d-24b1-420b-a8ee-dc476bc8cf15 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:10.462133 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b83e1c34-bdbe-472b-b7a0-6318353bf0ec tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:10.462693 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b83e1c34-bdbe-472b-b7a0-6318353bf0ec tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:10.469470 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b83e1c34-bdbe-472b-b7a0-6318353bf0ec tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:10.469944 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b83e1c34-bdbe-472b-b7a0-6318353bf0ec tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:10.470685 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b83e1c34-bdbe-472b-b7a0-6318353bf0ec tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:10.471125 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b83e1c34-bdbe-472b-b7a0-6318353bf0ec tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:10.575755 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-4a63a35d-24b1-420b-a8ee-dc476bc8cf15 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:10.584149 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-4a63a35d-24b1-420b-a8ee-dc476bc8cf15 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.191024 Apr 11 16:37:10.584744 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 135/280] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:10 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:10.620244 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b83e1c34-bdbe-472b-b7a0-6318353bf0ec tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:10.628967 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b83e1c34-bdbe-472b-b7a0-6318353bf0ec tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1554 microversion: 2.1 time: 0.170374 Apr 11 16:37:10.629561 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 146/281] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:10 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:11.601957 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-b722075c-e413-4c9b-9f80-c7b2921994eb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:11.602561 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-b722075c-e413-4c9b-9f80-c7b2921994eb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:11.609111 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b722075c-e413-4c9b-9f80-c7b2921994eb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:11.609557 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b722075c-e413-4c9b-9f80-c7b2921994eb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:11.610338 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b722075c-e413-4c9b-9f80-c7b2921994eb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:11.610769 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b722075c-e413-4c9b-9f80-c7b2921994eb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:11.646280 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-be897e80-37b1-4a29-9985-3136a5ff3467 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:11.646836 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-be897e80-37b1-4a29-9985-3136a5ff3467 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:11.653452 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-be897e80-37b1-4a29-9985-3136a5ff3467 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:11.653890 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-be897e80-37b1-4a29-9985-3136a5ff3467 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:11.654656 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-be897e80-37b1-4a29-9985-3136a5ff3467 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:11.655080 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-be897e80-37b1-4a29-9985-3136a5ff3467 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:11.792530 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-b722075c-e413-4c9b-9f80-c7b2921994eb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:11.800447 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-b722075c-e413-4c9b-9f80-c7b2921994eb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.202402 Apr 11 16:37:11.801067 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 136/282] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:11 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:11.820225 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-be897e80-37b1-4a29-9985-3136a5ff3467 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:11.828641 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-be897e80-37b1-4a29-9985-3136a5ff3467 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1554 microversion: 2.1 time: 0.186297 Apr 11 16:37:11.829219 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 147/283] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:11 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:12.821820 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-da7da764-f03c-41b6-8b3f-16e522d12f5b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:12.822531 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-da7da764-f03c-41b6-8b3f-16e522d12f5b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:12.829672 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-da7da764-f03c-41b6-8b3f-16e522d12f5b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:12.830132 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-da7da764-f03c-41b6-8b3f-16e522d12f5b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:12.830867 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-da7da764-f03c-41b6-8b3f-16e522d12f5b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:12.831292 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-da7da764-f03c-41b6-8b3f-16e522d12f5b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:12.846239 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-df28c375-2fb8-451f-a8c9-80b2dec378f2 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:12.846806 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-df28c375-2fb8-451f-a8c9-80b2dec378f2 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:12.853311 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-df28c375-2fb8-451f-a8c9-80b2dec378f2 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:12.854063 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-df28c375-2fb8-451f-a8c9-80b2dec378f2 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:12.854652 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-df28c375-2fb8-451f-a8c9-80b2dec378f2 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:12.855088 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-df28c375-2fb8-451f-a8c9-80b2dec378f2 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:13.033057 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-da7da764-f03c-41b6-8b3f-16e522d12f5b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:13.036955 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-df28c375-2fb8-451f-a8c9-80b2dec378f2 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:13.041531 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-da7da764-f03c-41b6-8b3f-16e522d12f5b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.225133 Apr 11 16:37:13.042323 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 137/284] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:12 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:13.045737 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-df28c375-2fb8-451f-a8c9-80b2dec378f2 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1554 microversion: 2.1 time: 0.203371 Apr 11 16:37:13.046307 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 148/285] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:12 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1554 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:14.059077 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c57d4cfe-0d1a-4db6-a7e6-c423f9c1361d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:14.059845 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c57d4cfe-0d1a-4db6-a7e6-c423f9c1361d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:14.064582 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-11c95f6c-9487-418d-b445-2c56aa2e90a8 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:14.065205 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-11c95f6c-9487-418d-b445-2c56aa2e90a8 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:14.067504 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c57d4cfe-0d1a-4db6-a7e6-c423f9c1361d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:14.069050 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c57d4cfe-0d1a-4db6-a7e6-c423f9c1361d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:14.069941 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c57d4cfe-0d1a-4db6-a7e6-c423f9c1361d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:14.070652 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c57d4cfe-0d1a-4db6-a7e6-c423f9c1361d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:14.072504 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-11c95f6c-9487-418d-b445-2c56aa2e90a8 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:14.072951 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-11c95f6c-9487-418d-b445-2c56aa2e90a8 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:14.073998 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-11c95f6c-9487-418d-b445-2c56aa2e90a8 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:14.074432 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-11c95f6c-9487-418d-b445-2c56aa2e90a8 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:14.339679 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c57d4cfe-0d1a-4db6-a7e6-c423f9c1361d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:14.348025 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c57d4cfe-0d1a-4db6-a7e6-c423f9c1361d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.293003 Apr 11 16:37:14.349054 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 138/286] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:14 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:14.366871 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-11c95f6c-9487-418d-b445-2c56aa2e90a8 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:14.376951 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-11c95f6c-9487-418d-b445-2c56aa2e90a8 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1554 microversion: 2.1 time: 0.318118 Apr 11 16:37:14.377573 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 149/287] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:14 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1554 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:15.364242 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-be63060b-15d6-42d6-8f51-cb75fbf80d50 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:15.364908 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-be63060b-15d6-42d6-8f51-cb75fbf80d50 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:15.372476 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-be63060b-15d6-42d6-8f51-cb75fbf80d50 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:15.372916 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-be63060b-15d6-42d6-8f51-cb75fbf80d50 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:15.373717 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-be63060b-15d6-42d6-8f51-cb75fbf80d50 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:15.374129 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-be63060b-15d6-42d6-8f51-cb75fbf80d50 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:15.394511 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1bac50a8-7f6f-4df5-93b6-adf28e9a5ccd tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:15.395094 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1bac50a8-7f6f-4df5-93b6-adf28e9a5ccd tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:15.403707 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1bac50a8-7f6f-4df5-93b6-adf28e9a5ccd tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:15.403707 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1bac50a8-7f6f-4df5-93b6-adf28e9a5ccd tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:15.404818 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1bac50a8-7f6f-4df5-93b6-adf28e9a5ccd tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:15.404818 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1bac50a8-7f6f-4df5-93b6-adf28e9a5ccd tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:15.581573 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-be63060b-15d6-42d6-8f51-cb75fbf80d50 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:15.591702 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-be63060b-15d6-42d6-8f51-cb75fbf80d50 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.231177 Apr 11 16:37:15.592814 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 139/288] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:15 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:15.599115 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1bac50a8-7f6f-4df5-93b6-adf28e9a5ccd tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:15.608857 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1bac50a8-7f6f-4df5-93b6-adf28e9a5ccd tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1554 microversion: 2.1 time: 0.217947 Apr 11 16:37:15.609447 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 150/289] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:15 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1554 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:16.610129 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-29d390ec-b397-44a0-8b68-72cad6296558 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:16.610762 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-29d390ec-b397-44a0-8b68-72cad6296558 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:16.617353 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-29d390ec-b397-44a0-8b68-72cad6296558 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:16.617788 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-29d390ec-b397-44a0-8b68-72cad6296558 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:16.618602 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-29d390ec-b397-44a0-8b68-72cad6296558 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:16.618961 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-29d390ec-b397-44a0-8b68-72cad6296558 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:16.629621 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b8e6a7d9-b595-4ad6-b63c-ae69870099da tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:16.630444 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b8e6a7d9-b595-4ad6-b63c-ae69870099da tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:16.637656 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b8e6a7d9-b595-4ad6-b63c-ae69870099da tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:16.638460 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b8e6a7d9-b595-4ad6-b63c-ae69870099da tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:16.639918 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b8e6a7d9-b595-4ad6-b63c-ae69870099da tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:16.640483 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b8e6a7d9-b595-4ad6-b63c-ae69870099da tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:16.823922 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-29d390ec-b397-44a0-8b68-72cad6296558 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:16.832540 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-29d390ec-b397-44a0-8b68-72cad6296558 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.226245 Apr 11 16:37:16.833264 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 140/290] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:16 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:37:16.838239 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b8e6a7d9-b595-4ad6-b63c-ae69870099da tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:16.850852 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b8e6a7d9-b595-4ad6-b63c-ae69870099da tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1554 microversion: 2.1 time: 0.225638 Apr 11 16:37:16.851686 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 151/291] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:16 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1554 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:17.850305 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-4fd84a85-4916-4af7-8a60-aad545ed8def tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:17.850854 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-4fd84a85-4916-4af7-8a60-aad545ed8def tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:17.859459 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4fd84a85-4916-4af7-8a60-aad545ed8def tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:17.859722 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4fd84a85-4916-4af7-8a60-aad545ed8def tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:17.860719 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4fd84a85-4916-4af7-8a60-aad545ed8def tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:17.861126 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4fd84a85-4916-4af7-8a60-aad545ed8def tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:17.875408 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b21062a7-090c-45cc-a854-e7358d2efec9 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:17.876394 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b21062a7-090c-45cc-a854-e7358d2efec9 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:17.884737 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b21062a7-090c-45cc-a854-e7358d2efec9 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:17.885336 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b21062a7-090c-45cc-a854-e7358d2efec9 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:17.886692 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b21062a7-090c-45cc-a854-e7358d2efec9 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:17.887389 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b21062a7-090c-45cc-a854-e7358d2efec9 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:18.004293 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b21062a7-090c-45cc-a854-e7358d2efec9 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9e10f29bcf4b6bb2a1674763e2dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46281803c3eb4cfbaf258d62f8c4d916', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:18.015936 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b21062a7-090c-45cc-a854-e7358d2efec9 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 200 len: 1512 microversion: 2.1 time: 0.145979 Apr 11 16:37:18.031906 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 152/292] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:17 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:37:18.042636 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-11c51fed-a809-4ac7-815e-3f772c2bb373 req-3a34033d-c759-43ca-85e1-9d8d5aef25af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3017c9b9-0056-46a2-b176-6036aad45db0", "name": "network-vif-deleted", "tag": "945545f7-d75c-4885-8d14-73d74d4f110d"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:37:18.052489 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-11c51fed-a809-4ac7-815e-3f772c2bb373 req-3a34033d-c759-43ca-85e1-9d8d5aef25af service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:18.052834 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-11c51fed-a809-4ac7-815e-3f772c2bb373 req-3a34033d-c759-43ca-85e1-9d8d5aef25af service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:18.065994 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-11c51fed-a809-4ac7-815e-3f772c2bb373 req-3a34033d-c759-43ca-85e1-9d8d5aef25af service nova] Creating event network-vif-deleted:945545f7-d75c-4885-8d14-73d74d4f110d for instance 3017c9b9-0056-46a2-b176-6036aad45db0 on hv-cinder-83716 Apr 11 16:37:18.071207 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-11c51fed-a809-4ac7-815e-3f772c2bb373 req-3a34033d-c759-43ca-85e1-9d8d5aef25af service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037690 Apr 11 16:37:18.071900 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 153/293] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:37:18.086433 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-4fd84a85-4916-4af7-8a60-aad545ed8def tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:18.094647 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-4fd84a85-4916-4af7-8a60-aad545ed8def tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.248283 Apr 11 16:37:18.095238 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 141/294] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:17 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:19.034773 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-254d8cd9-e03c-4ffd-be1b-6f97306505ad tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:19.035749 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-254d8cd9-e03c-4ffd-be1b-6f97306505ad tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:19.056533 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-254d8cd9-e03c-4ffd-be1b-6f97306505ad tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:19.056979 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-254d8cd9-e03c-4ffd-be1b-6f97306505ad tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:19.057730 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-254d8cd9-e03c-4ffd-be1b-6f97306505ad tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:19.060050 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-254d8cd9-e03c-4ffd-be1b-6f97306505ad tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:19.083041 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-254d8cd9-e03c-4ffd-be1b-6f97306505ad tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] HTTP exception thrown: Instance 3017c9b9-0056-46a2-b176-6036aad45db0 could not be found. Apr 11 16:37:19.083970 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-254d8cd9-e03c-4ffd-be1b-6f97306505ad tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Returning 404 to user: Instance 3017c9b9-0056-46a2-b176-6036aad45db0 could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:37:19.084785 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-254d8cd9-e03c-4ffd-be1b-6f97306505ad tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 404 len: 111 microversion: 2.1 time: 0.054590 Apr 11 16:37:19.097730 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 154/295] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:19 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:37:19.112745 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-0001d2f9-6f2b-49aa-bf66-b95eca6e1a4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:19.114278 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-0001d2f9-6f2b-49aa-bf66-b95eca6e1a4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:19.125466 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0001d2f9-6f2b-49aa-bf66-b95eca6e1a4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:19.125904 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0001d2f9-6f2b-49aa-bf66-b95eca6e1a4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:19.132819 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0001d2f9-6f2b-49aa-bf66-b95eca6e1a4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:19.133563 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0001d2f9-6f2b-49aa-bf66-b95eca6e1a4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:19.246019 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-023529ef-aaf5-4f90-8902-6db51c7fdd56 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:19.247453 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-023529ef-aaf5-4f90-8902-6db51c7fdd56 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:19.262678 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-023529ef-aaf5-4f90-8902-6db51c7fdd56 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:19.263569 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-023529ef-aaf5-4f90-8902-6db51c7fdd56 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:19.264405 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-023529ef-aaf5-4f90-8902-6db51c7fdd56 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:19.264841 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-023529ef-aaf5-4f90-8902-6db51c7fdd56 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:19.292145 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-023529ef-aaf5-4f90-8902-6db51c7fdd56 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] HTTP exception thrown: Instance 3017c9b9-0056-46a2-b176-6036aad45db0 could not be found. Apr 11 16:37:19.292932 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-023529ef-aaf5-4f90-8902-6db51c7fdd56 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Returning 404 to user: Instance 3017c9b9-0056-46a2-b176-6036aad45db0 could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:37:19.293776 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-023529ef-aaf5-4f90-8902-6db51c7fdd56 tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.059492 Apr 11 16:37:19.303693 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 155/296] 10.222.0.65 () {58 vars in 1301 bytes} [Mon Apr 11 16:37:19 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0/os-volume_attachments => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 16:37:19.355462 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0001d2f9-6f2b-49aa-bf66-b95eca6e1a4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:19.363853 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-0001d2f9-6f2b-49aa-bf66-b95eca6e1a4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.256068 Apr 11 16:37:19.364444 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 142/297] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:19 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:20.386312 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ae25eae3-aba6-4d40-a0d8-0356f6218498 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:20.387861 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ae25eae3-aba6-4d40-a0d8-0356f6218498 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:20.397095 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ae25eae3-aba6-4d40-a0d8-0356f6218498 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:20.397361 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ae25eae3-aba6-4d40-a0d8-0356f6218498 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:20.398274 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ae25eae3-aba6-4d40-a0d8-0356f6218498 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:20.398920 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ae25eae3-aba6-4d40-a0d8-0356f6218498 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:20.539992 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-b944ccb0-ab61-4806-80d7-046ab03a4b8c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:20.540776 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-b944ccb0-ab61-4806-80d7-046ab03a4b8c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:20.552536 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ae25eae3-aba6-4d40-a0d8-0356f6218498 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:20.553158 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b944ccb0-ab61-4806-80d7-046ab03a4b8c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:20.553819 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b944ccb0-ab61-4806-80d7-046ab03a4b8c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:20.554955 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b944ccb0-ab61-4806-80d7-046ab03a4b8c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:20.555568 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b944ccb0-ab61-4806-80d7-046ab03a4b8c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:20.561819 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ae25eae3-aba6-4d40-a0d8-0356f6218498 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.183720 Apr 11 16:37:20.566135 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 156/298] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:20 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:20.575880 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-b944ccb0-ab61-4806-80d7-046ab03a4b8c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] HTTP exception thrown: Instance 3017c9b9-0056-46a2-b176-6036aad45db0 could not be found. Apr 11 16:37:20.576763 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-b944ccb0-ab61-4806-80d7-046ab03a4b8c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Returning 404 to user: Instance 3017c9b9-0056-46a2-b176-6036aad45db0 could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:37:20.577837 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-b944ccb0-ab61-4806-80d7-046ab03a4b8c tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 404 len: 111 microversion: 2.1 time: 0.042229 Apr 11 16:37:20.578300 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 143/299] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:37:20 2022] DELETE /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 16:37:20.586443 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-bec25b53-bf6c-44e6-b3ea-04466d51df8f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:20.587063 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-bec25b53-bf6c-44e6-b3ea-04466d51df8f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] [instance: 3017c9b9-0056-46a2-b176-6036aad45db0] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:20.594266 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bec25b53-bf6c-44e6-b3ea-04466d51df8f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:20.594695 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bec25b53-bf6c-44e6-b3ea-04466d51df8f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:20.595463 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bec25b53-bf6c-44e6-b3ea-04466d51df8f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:20.595911 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bec25b53-bf6c-44e6-b3ea-04466d51df8f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:20.612681 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-bec25b53-bf6c-44e6-b3ea-04466d51df8f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] HTTP exception thrown: Instance 3017c9b9-0056-46a2-b176-6036aad45db0 could not be found. Apr 11 16:37:20.613324 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-bec25b53-bf6c-44e6-b3ea-04466d51df8f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] Returning 404 to user: Instance 3017c9b9-0056-46a2-b176-6036aad45db0 could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:37:20.614085 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-bec25b53-bf6c-44e6-b3ea-04466d51df8f tempest-DeleteServersTestJSON-1508589221 tempest-DeleteServersTestJSON-1508589221-project] 10.222.0.65 "GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0" status: 404 len: 111 microversion: 2.1 time: 0.031539 Apr 11 16:37:20.614922 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 157/300] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:20 2022] GET /compute/v2.1/servers/3017c9b9-0056-46a2-b176-6036aad45db0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 16:37:21.582010 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-8983504e-7292-437d-865d-24ea9d1544a4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:21.582878 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-8983504e-7292-437d-865d-24ea9d1544a4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:21.597779 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8983504e-7292-437d-865d-24ea9d1544a4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:21.598607 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8983504e-7292-437d-865d-24ea9d1544a4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:21.599821 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8983504e-7292-437d-865d-24ea9d1544a4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:21.600571 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8983504e-7292-437d-865d-24ea9d1544a4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:21.833524 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8983504e-7292-437d-865d-24ea9d1544a4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:21.843175 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-8983504e-7292-437d-865d-24ea9d1544a4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.264967 Apr 11 16:37:21.844455 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 144/301] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:21 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:22.861096 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1394bc04-b63a-4342-b325-4821069d7c0c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:22.861777 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1394bc04-b63a-4342-b325-4821069d7c0c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:22.871870 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1394bc04-b63a-4342-b325-4821069d7c0c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:22.872338 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1394bc04-b63a-4342-b325-4821069d7c0c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:22.873113 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1394bc04-b63a-4342-b325-4821069d7c0c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:22.874807 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1394bc04-b63a-4342-b325-4821069d7c0c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:23.025055 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1394bc04-b63a-4342-b325-4821069d7c0c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:23.037122 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1394bc04-b63a-4342-b325-4821069d7c0c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.179904 Apr 11 16:37:23.042319 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 158/302] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:22 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:24.055443 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5b2bad21-3eee-425b-b861-fa8e11c30a23 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:24.056132 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5b2bad21-3eee-425b-b861-fa8e11c30a23 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:24.063005 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5b2bad21-3eee-425b-b861-fa8e11c30a23 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:24.063503 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5b2bad21-3eee-425b-b861-fa8e11c30a23 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:24.064365 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5b2bad21-3eee-425b-b861-fa8e11c30a23 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:24.064802 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5b2bad21-3eee-425b-b861-fa8e11c30a23 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:24.258901 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5b2bad21-3eee-425b-b861-fa8e11c30a23 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:24.268638 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5b2bad21-3eee-425b-b861-fa8e11c30a23 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.218060 Apr 11 16:37:24.269535 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 145/303] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:24 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:25.291944 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-a050683c-e595-4eed-8e97-0a6935770ce3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:25.292604 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-a050683c-e595-4eed-8e97-0a6935770ce3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:25.303683 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a050683c-e595-4eed-8e97-0a6935770ce3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:25.304117 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a050683c-e595-4eed-8e97-0a6935770ce3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:25.305231 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a050683c-e595-4eed-8e97-0a6935770ce3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:25.306132 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a050683c-e595-4eed-8e97-0a6935770ce3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:25.479084 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-a050683c-e595-4eed-8e97-0a6935770ce3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:25.488555 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-a050683c-e595-4eed-8e97-0a6935770ce3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.200737 Apr 11 16:37:25.489603 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 159/304] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:25 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:26.507022 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-110178af-9173-4afd-87a4-19a743d50a07 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:26.507620 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-110178af-9173-4afd-87a4-19a743d50a07 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:26.514651 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-110178af-9173-4afd-87a4-19a743d50a07 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:26.515356 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-110178af-9173-4afd-87a4-19a743d50a07 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:26.516165 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-110178af-9173-4afd-87a4-19a743d50a07 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:26.516729 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-110178af-9173-4afd-87a4-19a743d50a07 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:26.677668 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-110178af-9173-4afd-87a4-19a743d50a07 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:26.690434 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-110178af-9173-4afd-87a4-19a743d50a07 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.187452 Apr 11 16:37:26.691159 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 146/305] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:26 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:27.710085 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-052e1d98-7b3a-4aee-befd-7eb84202c3e5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:27.710677 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-052e1d98-7b3a-4aee-befd-7eb84202c3e5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:27.717242 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-052e1d98-7b3a-4aee-befd-7eb84202c3e5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:27.717680 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-052e1d98-7b3a-4aee-befd-7eb84202c3e5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:27.718452 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-052e1d98-7b3a-4aee-befd-7eb84202c3e5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:27.718901 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-052e1d98-7b3a-4aee-befd-7eb84202c3e5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:27.853411 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-052e1d98-7b3a-4aee-befd-7eb84202c3e5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:27.865152 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-052e1d98-7b3a-4aee-befd-7eb84202c3e5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.158858 Apr 11 16:37:27.865735 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 160/306] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:27 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:28.882777 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-bb874fca-74cb-4427-ba31-308d5db29847 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:28.883332 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-bb874fca-74cb-4427-ba31-308d5db29847 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:28.890160 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bb874fca-74cb-4427-ba31-308d5db29847 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:28.890604 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bb874fca-74cb-4427-ba31-308d5db29847 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:28.891340 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bb874fca-74cb-4427-ba31-308d5db29847 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:28.891800 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bb874fca-74cb-4427-ba31-308d5db29847 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:29.024435 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-bb874fca-74cb-4427-ba31-308d5db29847 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:29.033473 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-bb874fca-74cb-4427-ba31-308d5db29847 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.154517 Apr 11 16:37:29.034064 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 147/307] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:28 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:30.050313 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-dc335109-ca85-4e23-b11b-508f2cbe4757 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:30.051023 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-dc335109-ca85-4e23-b11b-508f2cbe4757 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:30.057159 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dc335109-ca85-4e23-b11b-508f2cbe4757 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:30.057741 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dc335109-ca85-4e23-b11b-508f2cbe4757 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:30.058730 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dc335109-ca85-4e23-b11b-508f2cbe4757 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:30.059131 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dc335109-ca85-4e23-b11b-508f2cbe4757 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:30.200773 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-dc335109-ca85-4e23-b11b-508f2cbe4757 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:30.209306 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-dc335109-ca85-4e23-b11b-508f2cbe4757 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.162741 Apr 11 16:37:30.209896 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 161/308] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:30 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:31.226488 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-37ec4fdc-8a0c-4970-b9cf-5ea30f4c5ff8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:31.227144 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-37ec4fdc-8a0c-4970-b9cf-5ea30f4c5ff8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:31.235461 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-37ec4fdc-8a0c-4970-b9cf-5ea30f4c5ff8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:31.236176 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-37ec4fdc-8a0c-4970-b9cf-5ea30f4c5ff8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:31.236959 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-37ec4fdc-8a0c-4970-b9cf-5ea30f4c5ff8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:31.237382 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-37ec4fdc-8a0c-4970-b9cf-5ea30f4c5ff8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:31.374863 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-37ec4fdc-8a0c-4970-b9cf-5ea30f4c5ff8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:31.383649 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-37ec4fdc-8a0c-4970-b9cf-5ea30f4c5ff8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.160934 Apr 11 16:37:31.384236 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 148/309] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:31 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:32.403727 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3d19fd15-77a8-4850-89fc-a4e1bdcd353e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:32.404580 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3d19fd15-77a8-4850-89fc-a4e1bdcd353e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:32.412000 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3d19fd15-77a8-4850-89fc-a4e1bdcd353e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:32.412595 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3d19fd15-77a8-4850-89fc-a4e1bdcd353e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:32.413505 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3d19fd15-77a8-4850-89fc-a4e1bdcd353e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:32.413969 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3d19fd15-77a8-4850-89fc-a4e1bdcd353e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:32.581325 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3d19fd15-77a8-4850-89fc-a4e1bdcd353e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:32.593776 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3d19fd15-77a8-4850-89fc-a4e1bdcd353e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.195065 Apr 11 16:37:32.594739 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 162/310] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:32 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:33.612536 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-4fec9222-20c5-4d92-8ea1-25c52e5fda29 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:33.613852 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-4fec9222-20c5-4d92-8ea1-25c52e5fda29 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:33.622085 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4fec9222-20c5-4d92-8ea1-25c52e5fda29 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:33.624423 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4fec9222-20c5-4d92-8ea1-25c52e5fda29 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:33.625819 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4fec9222-20c5-4d92-8ea1-25c52e5fda29 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:33.626475 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4fec9222-20c5-4d92-8ea1-25c52e5fda29 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:33.833488 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-4fec9222-20c5-4d92-8ea1-25c52e5fda29 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:33.842311 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-4fec9222-20c5-4d92-8ea1-25c52e5fda29 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.234559 Apr 11 16:37:33.842897 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 149/311] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:33 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:34.860642 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-6553ebd4-8909-462d-a96d-ba4681decf04 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:34.861369 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-6553ebd4-8909-462d-a96d-ba4681decf04 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:34.872659 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6553ebd4-8909-462d-a96d-ba4681decf04 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:34.873218 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6553ebd4-8909-462d-a96d-ba4681decf04 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:34.874053 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6553ebd4-8909-462d-a96d-ba4681decf04 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:34.874474 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6553ebd4-8909-462d-a96d-ba4681decf04 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:35.198390 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6553ebd4-8909-462d-a96d-ba4681decf04 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:35.212027 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-6553ebd4-8909-462d-a96d-ba4681decf04 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1521 microversion: 2.1 time: 0.355845 Apr 11 16:37:35.212626 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 163/312] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:34 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:36.231152 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e77866bb-63d8-4f77-8132-385946960b2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:36.231814 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e77866bb-63d8-4f77-8132-385946960b2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:36.241128 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e77866bb-63d8-4f77-8132-385946960b2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:36.244669 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e77866bb-63d8-4f77-8132-385946960b2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:36.244669 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e77866bb-63d8-4f77-8132-385946960b2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:36.244669 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e77866bb-63d8-4f77-8132-385946960b2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:36.618846 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e77866bb-63d8-4f77-8132-385946960b2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:36.650953 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e77866bb-63d8-4f77-8132-385946960b2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1501 microversion: 2.1 time: 0.423826 Apr 11 16:37:36.652245 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 150/313] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:36 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1501 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:36.668863 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-29bcb65d-9809-4d52-b6f6-76cc27819031 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:36.669508 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-29bcb65d-9809-4d52-b6f6-76cc27819031 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:36.689546 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-29bcb65d-9809-4d52-b6f6-76cc27819031 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:36.691609 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-29bcb65d-9809-4d52-b6f6-76cc27819031 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:36.692679 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-29bcb65d-9809-4d52-b6f6-76cc27819031 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:36.693121 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-29bcb65d-9809-4d52-b6f6-76cc27819031 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:36.983955 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-29bcb65d-9809-4d52-b6f6-76cc27819031 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:36.992792 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-29bcb65d-9809-4d52-b6f6-76cc27819031 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1514 microversion: 2.1 time: 0.328241 Apr 11 16:37:36.996845 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 164/314] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:36 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1514 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:39.772608 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ca44e99e-2e57-4bdc-8c08-324e8cb79e9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:37:39.773606 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ca44e99e-2e57-4bdc-8c08-324e8cb79e9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:39.783365 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ca44e99e-2e57-4bdc-8c08-324e8cb79e9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:39.784120 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ca44e99e-2e57-4bdc-8c08-324e8cb79e9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:39.785053 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ca44e99e-2e57-4bdc-8c08-324e8cb79e9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:39.785633 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ca44e99e-2e57-4bdc-8c08-324e8cb79e9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:39.826047 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.objects.instance [None req-ca44e99e-2e57-4bdc-8c08-324e8cb79e9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lazy-loading 'flavor' on Instance uuid a3dc4a3c-61a6-4e27-af48-37b52aa6a959 {{(pid=123774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:37:39.932461 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ca44e99e-2e57-4bdc-8c08-324e8cb79e9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "POST /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959/action" status: 200 len: 32 microversion: 2.1 time: 0.163676 Apr 11 16:37:39.933896 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 151/315] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Apr 11 16:37:39 2022] POST /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 16:37:39.945426 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-fcb83beb-08f8-41c9-b333-3f1ac33f3b29 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:39.946829 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-fcb83beb-08f8-41c9-b333-3f1ac33f3b29 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:39.957508 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fcb83beb-08f8-41c9-b333-3f1ac33f3b29 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:39.958219 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fcb83beb-08f8-41c9-b333-3f1ac33f3b29 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:39.959186 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fcb83beb-08f8-41c9-b333-3f1ac33f3b29 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:39.960091 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fcb83beb-08f8-41c9-b333-3f1ac33f3b29 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:40.269582 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-fcb83beb-08f8-41c9-b333-3f1ac33f3b29 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:40.280921 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-fcb83beb-08f8-41c9-b333-3f1ac33f3b29 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.340690 Apr 11 16:37:40.281828 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 165/316] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:39 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:41.301454 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-efb78b24-1d14-443f-8bbe-876ba4a73167 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:41.303957 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-efb78b24-1d14-443f-8bbe-876ba4a73167 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:41.311853 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-efb78b24-1d14-443f-8bbe-876ba4a73167 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:41.312629 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-efb78b24-1d14-443f-8bbe-876ba4a73167 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:41.314318 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-efb78b24-1d14-443f-8bbe-876ba4a73167 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:41.314969 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-efb78b24-1d14-443f-8bbe-876ba4a73167 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:41.625441 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-efb78b24-1d14-443f-8bbe-876ba4a73167 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:41.655572 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-efb78b24-1d14-443f-8bbe-876ba4a73167 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.359689 Apr 11 16:37:41.657530 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 152/317] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:41 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:42.674361 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-0d64d263-1748-4bcf-83ee-0072921d3a9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:42.674961 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-0d64d263-1748-4bcf-83ee-0072921d3a9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:42.681260 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0d64d263-1748-4bcf-83ee-0072921d3a9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:42.681690 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0d64d263-1748-4bcf-83ee-0072921d3a9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:42.682987 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0d64d263-1748-4bcf-83ee-0072921d3a9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:42.683430 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0d64d263-1748-4bcf-83ee-0072921d3a9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:42.927047 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-0d64d263-1748-4bcf-83ee-0072921d3a9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:42.937392 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-0d64d263-1748-4bcf-83ee-0072921d3a9f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.266893 Apr 11 16:37:42.938202 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 166/318] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:42 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:43.955573 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-06e0777c-af8e-4eb6-87c5-f6dc8d117e2d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:43.957719 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-06e0777c-af8e-4eb6-87c5-f6dc8d117e2d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:43.967971 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-06e0777c-af8e-4eb6-87c5-f6dc8d117e2d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:43.968456 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-06e0777c-af8e-4eb6-87c5-f6dc8d117e2d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:43.969274 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-06e0777c-af8e-4eb6-87c5-f6dc8d117e2d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:43.969704 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-06e0777c-af8e-4eb6-87c5-f6dc8d117e2d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:44.325969 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-06e0777c-af8e-4eb6-87c5-f6dc8d117e2d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:44.349374 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-06e0777c-af8e-4eb6-87c5-f6dc8d117e2d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.398351 Apr 11 16:37:44.349965 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 153/319] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:43 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:45.367005 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c828d8bc-13e5-46f4-bb91-04e441312432 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:45.367620 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c828d8bc-13e5-46f4-bb91-04e441312432 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:45.379985 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c828d8bc-13e5-46f4-bb91-04e441312432 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:45.380434 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c828d8bc-13e5-46f4-bb91-04e441312432 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:45.381226 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c828d8bc-13e5-46f4-bb91-04e441312432 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:45.381660 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c828d8bc-13e5-46f4-bb91-04e441312432 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:45.654006 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c828d8bc-13e5-46f4-bb91-04e441312432 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:45.665411 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c828d8bc-13e5-46f4-bb91-04e441312432 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.302321 Apr 11 16:37:45.674902 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 167/320] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:45 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:46.597877 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5e427c68-0ca9-441d-90f8-9c2d2aa8e645 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Action: 'create', calling method: .version_select at 0x7f74181513a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1532288997"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:37:46.619442 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-5e427c68-0ca9-441d-90f8-9c2d2aa8e645 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Getting quotas for project 0ad65af0201c40fea0218125fd073de1. Resources: {'key_pairs'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:37:46.628577 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-5e427c68-0ca9-441d-90f8-9c2d2aa8e645 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Getting quotas for user d6976dcc895e45bf8421ebab360a9536 and project 0ad65af0201c40fea0218125fd073de1. Resources: {'key_pairs'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:37:46.682726 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-fbbbafc3-9eef-472a-9a03-2df1643a4b13 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:46.683595 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-fbbbafc3-9eef-472a-9a03-2df1643a4b13 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:46.691726 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fbbbafc3-9eef-472a-9a03-2df1643a4b13 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:46.692157 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fbbbafc3-9eef-472a-9a03-2df1643a4b13 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:46.692922 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fbbbafc3-9eef-472a-9a03-2df1643a4b13 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:46.693344 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fbbbafc3-9eef-472a-9a03-2df1643a4b13 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:46.912995 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-5e427c68-0ca9-441d-90f8-9c2d2aa8e645 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Getting quotas for project 0ad65af0201c40fea0218125fd073de1. Resources: {'key_pairs'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:37:46.918655 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-5e427c68-0ca9-441d-90f8-9c2d2aa8e645 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Getting quotas for user d6976dcc895e45bf8421ebab360a9536 and project 0ad65af0201c40fea0218125fd073de1. Resources: {'key_pairs'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:37:46.932984 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5e427c68-0ca9-441d-90f8-9c2d2aa8e645 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.623102 Apr 11 16:37:46.934072 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 154/321] 10.222.0.65 () {60 vars in 1157 bytes} [Mon Apr 11 16:37:46 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:37:46.978478 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-fbbbafc3-9eef-472a-9a03-2df1643a4b13 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:46.987858 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-fbbbafc3-9eef-472a-9a03-2df1643a4b13 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.309169 Apr 11 16:37:46.989141 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 168/322] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:46 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:48.009286 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d2342884-0f25-4cdf-9d10-e4e16fe89b7e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:48.010524 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d2342884-0f25-4cdf-9d10-e4e16fe89b7e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:48.017967 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d2342884-0f25-4cdf-9d10-e4e16fe89b7e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:48.018407 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d2342884-0f25-4cdf-9d10-e4e16fe89b7e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:48.019167 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d2342884-0f25-4cdf-9d10-e4e16fe89b7e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:48.019587 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d2342884-0f25-4cdf-9d10-e4e16fe89b7e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:48.167500 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d2342884-0f25-4cdf-9d10-e4e16fe89b7e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:48.176467 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d2342884-0f25-4cdf-9d10-e4e16fe89b7e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.175953 Apr 11 16:37:48.177125 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 155/323] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:47 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:49.194280 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d293719b-8f9d-4aa6-b862-b95ea21fa257 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:49.194884 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d293719b-8f9d-4aa6-b862-b95ea21fa257 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:49.201419 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d293719b-8f9d-4aa6-b862-b95ea21fa257 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:49.201973 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d293719b-8f9d-4aa6-b862-b95ea21fa257 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:49.202802 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d293719b-8f9d-4aa6-b862-b95ea21fa257 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:49.203294 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d293719b-8f9d-4aa6-b862-b95ea21fa257 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:49.348951 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d293719b-8f9d-4aa6-b862-b95ea21fa257 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:49.357027 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d293719b-8f9d-4aa6-b862-b95ea21fa257 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.166704 Apr 11 16:37:49.357702 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 169/324] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:49 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:50.374588 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-781fb8b4-bb61-42a0-9bf3-3728de928c2b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:50.375234 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-781fb8b4-bb61-42a0-9bf3-3728de928c2b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:50.382342 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-781fb8b4-bb61-42a0-9bf3-3728de928c2b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:50.382772 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-781fb8b4-bb61-42a0-9bf3-3728de928c2b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:50.383530 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-781fb8b4-bb61-42a0-9bf3-3728de928c2b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:50.384011 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-781fb8b4-bb61-42a0-9bf3-3728de928c2b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:50.529045 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-781fb8b4-bb61-42a0-9bf3-3728de928c2b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:50.536994 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-781fb8b4-bb61-42a0-9bf3-3728de928c2b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.166328 Apr 11 16:37:50.537958 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 156/325] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:50 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:51.557581 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-2def69ec-6549-4820-a557-5f848ad958ec tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:51.558258 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-2def69ec-6549-4820-a557-5f848ad958ec tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:51.566109 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2def69ec-6549-4820-a557-5f848ad958ec tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:51.566745 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2def69ec-6549-4820-a557-5f848ad958ec tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:51.567729 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2def69ec-6549-4820-a557-5f848ad958ec tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:51.568265 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2def69ec-6549-4820-a557-5f848ad958ec tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:51.722148 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-2def69ec-6549-4820-a557-5f848ad958ec tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:51.729606 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-2def69ec-6549-4820-a557-5f848ad958ec tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.177197 Apr 11 16:37:51.730169 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 170/326] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:51 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:52.747393 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e1bcd215-d783-4f9d-90e2-010b91e5cb11 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:52.748024 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e1bcd215-d783-4f9d-90e2-010b91e5cb11 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:52.754995 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e1bcd215-d783-4f9d-90e2-010b91e5cb11 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:52.755434 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e1bcd215-d783-4f9d-90e2-010b91e5cb11 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:52.756242 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e1bcd215-d783-4f9d-90e2-010b91e5cb11 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:52.756648 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e1bcd215-d783-4f9d-90e2-010b91e5cb11 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:52.890711 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e1bcd215-d783-4f9d-90e2-010b91e5cb11 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:52.898105 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e1bcd215-d783-4f9d-90e2-010b91e5cb11 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.155303 Apr 11 16:37:52.898894 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 157/327] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:52 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:53.915437 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-405372ed-b9eb-47a3-9fe0-344f3c8793fb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:53.916258 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-405372ed-b9eb-47a3-9fe0-344f3c8793fb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:53.923466 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-405372ed-b9eb-47a3-9fe0-344f3c8793fb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:53.923926 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-405372ed-b9eb-47a3-9fe0-344f3c8793fb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:53.924726 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-405372ed-b9eb-47a3-9fe0-344f3c8793fb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:53.925139 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-405372ed-b9eb-47a3-9fe0-344f3c8793fb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:54.062703 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-405372ed-b9eb-47a3-9fe0-344f3c8793fb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:54.071869 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-405372ed-b9eb-47a3-9fe0-344f3c8793fb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.160319 Apr 11 16:37:54.072584 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 171/328] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:53 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:55.095359 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-2393c300-eff0-4e17-92a1-fa24f4225de0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:55.095987 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-2393c300-eff0-4e17-92a1-fa24f4225de0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:55.104290 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2393c300-eff0-4e17-92a1-fa24f4225de0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:55.104703 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2393c300-eff0-4e17-92a1-fa24f4225de0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:55.105507 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2393c300-eff0-4e17-92a1-fa24f4225de0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:55.105934 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2393c300-eff0-4e17-92a1-fa24f4225de0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:55.241910 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-2393c300-eff0-4e17-92a1-fa24f4225de0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:55.253419 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-2393c300-eff0-4e17-92a1-fa24f4225de0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.163239 Apr 11 16:37:55.254142 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 158/329] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:55 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:56.276889 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c278149b-23ab-4a64-a868-23e0a372a41d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:56.277722 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c278149b-23ab-4a64-a868-23e0a372a41d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:56.284677 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c278149b-23ab-4a64-a868-23e0a372a41d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:56.285125 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c278149b-23ab-4a64-a868-23e0a372a41d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:56.285884 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c278149b-23ab-4a64-a868-23e0a372a41d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:56.286316 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c278149b-23ab-4a64-a868-23e0a372a41d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:56.430056 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c278149b-23ab-4a64-a868-23e0a372a41d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:56.438021 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c278149b-23ab-4a64-a868-23e0a372a41d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.167788 Apr 11 16:37:56.438603 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 172/330] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:56 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:57.457919 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e0aa2d05-8d4c-4865-9c1b-8209491a0bd4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:57.458588 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e0aa2d05-8d4c-4865-9c1b-8209491a0bd4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:57.472418 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e0aa2d05-8d4c-4865-9c1b-8209491a0bd4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:57.473497 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e0aa2d05-8d4c-4865-9c1b-8209491a0bd4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:57.475442 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e0aa2d05-8d4c-4865-9c1b-8209491a0bd4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:57.476425 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e0aa2d05-8d4c-4865-9c1b-8209491a0bd4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:57.641306 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e0aa2d05-8d4c-4865-9c1b-8209491a0bd4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:57.650053 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e0aa2d05-8d4c-4865-9c1b-8209491a0bd4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.197918 Apr 11 16:37:57.650638 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 159/331] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:57 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:58.669723 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ff4ce076-28da-4c3c-a391-5d22b4176d5f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:58.670277 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ff4ce076-28da-4c3c-a391-5d22b4176d5f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:58.676760 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ff4ce076-28da-4c3c-a391-5d22b4176d5f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:58.677237 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ff4ce076-28da-4c3c-a391-5d22b4176d5f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:58.678125 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ff4ce076-28da-4c3c-a391-5d22b4176d5f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:58.678586 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ff4ce076-28da-4c3c-a391-5d22b4176d5f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:58.818949 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ff4ce076-28da-4c3c-a391-5d22b4176d5f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:58.829046 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ff4ce076-28da-4c3c-a391-5d22b4176d5f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.163481 Apr 11 16:37:58.829679 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 173/332] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:58 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:59.849565 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-db4177fd-2bb1-4421-bc18-5c0676b72041 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:37:59.850724 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-db4177fd-2bb1-4421-bc18-5c0676b72041 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:37:59.860506 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-db4177fd-2bb1-4421-bc18-5c0676b72041 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:59.860947 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-db4177fd-2bb1-4421-bc18-5c0676b72041 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:59.861700 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-db4177fd-2bb1-4421-bc18-5c0676b72041 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:37:59.862136 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-db4177fd-2bb1-4421-bc18-5c0676b72041 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:37:59.990750 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-db4177fd-2bb1-4421-bc18-5c0676b72041 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:37:59.998203 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-db4177fd-2bb1-4421-bc18-5c0676b72041 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.155338 Apr 11 16:37:59.998790 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 160/333] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:37:59 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:01.015857 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-35fb5950-63ef-4926-b791-dc31f97ba8f4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:01.016458 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-35fb5950-63ef-4926-b791-dc31f97ba8f4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:01.023109 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-35fb5950-63ef-4926-b791-dc31f97ba8f4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:01.023546 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-35fb5950-63ef-4926-b791-dc31f97ba8f4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:01.024334 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-35fb5950-63ef-4926-b791-dc31f97ba8f4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:01.024757 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-35fb5950-63ef-4926-b791-dc31f97ba8f4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:01.170022 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-35fb5950-63ef-4926-b791-dc31f97ba8f4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:01.177598 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-35fb5950-63ef-4926-b791-dc31f97ba8f4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.165789 Apr 11 16:38:01.178173 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 174/334] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:01 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:02.194743 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-89810a12-4788-41c1-8b33-319ecf3ba2a2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:02.195359 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-89810a12-4788-41c1-8b33-319ecf3ba2a2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:02.202117 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-89810a12-4788-41c1-8b33-319ecf3ba2a2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:02.202561 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-89810a12-4788-41c1-8b33-319ecf3ba2a2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:02.203326 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-89810a12-4788-41c1-8b33-319ecf3ba2a2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:02.203793 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-89810a12-4788-41c1-8b33-319ecf3ba2a2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:02.336330 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-89810a12-4788-41c1-8b33-319ecf3ba2a2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:02.343597 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-89810a12-4788-41c1-8b33-319ecf3ba2a2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.153053 Apr 11 16:38:02.344187 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 161/335] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:02 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:03.363982 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-5441e038-ceba-44a6-997a-ef085c5ab377 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:03.364583 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-5441e038-ceba-44a6-997a-ef085c5ab377 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:03.372443 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5441e038-ceba-44a6-997a-ef085c5ab377 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:03.372912 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5441e038-ceba-44a6-997a-ef085c5ab377 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:03.373676 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5441e038-ceba-44a6-997a-ef085c5ab377 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:03.374099 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5441e038-ceba-44a6-997a-ef085c5ab377 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:03.513915 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5441e038-ceba-44a6-997a-ef085c5ab377 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:03.521717 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-5441e038-ceba-44a6-997a-ef085c5ab377 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.163755 Apr 11 16:38:03.522288 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 175/336] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:03 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:04.539138 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ad9fe7d1-7bcb-4deb-bf80-b2e3d7655f43 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:04.539745 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ad9fe7d1-7bcb-4deb-bf80-b2e3d7655f43 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:04.546475 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ad9fe7d1-7bcb-4deb-bf80-b2e3d7655f43 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:04.546912 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ad9fe7d1-7bcb-4deb-bf80-b2e3d7655f43 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:04.547681 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ad9fe7d1-7bcb-4deb-bf80-b2e3d7655f43 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:04.548113 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ad9fe7d1-7bcb-4deb-bf80-b2e3d7655f43 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:04.919316 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ad9fe7d1-7bcb-4deb-bf80-b2e3d7655f43 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:04.927429 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ad9fe7d1-7bcb-4deb-bf80-b2e3d7655f43 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.392341 Apr 11 16:38:04.928037 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 162/337] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:04 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:05.947004 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c0ba1538-ef5b-40b6-acfc-3c38c1210ad2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:05.947542 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c0ba1538-ef5b-40b6-acfc-3c38c1210ad2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:05.954080 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c0ba1538-ef5b-40b6-acfc-3c38c1210ad2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:05.954513 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c0ba1538-ef5b-40b6-acfc-3c38c1210ad2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:05.955289 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c0ba1538-ef5b-40b6-acfc-3c38c1210ad2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:05.955928 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c0ba1538-ef5b-40b6-acfc-3c38c1210ad2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:06.089125 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c0ba1538-ef5b-40b6-acfc-3c38c1210ad2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:06.097291 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c0ba1538-ef5b-40b6-acfc-3c38c1210ad2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.154262 Apr 11 16:38:06.097828 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 176/338] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:05 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:07.118791 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-b4cbd40d-fa09-4c90-a2f2-ef375b72cbfa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:07.119400 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-b4cbd40d-fa09-4c90-a2f2-ef375b72cbfa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:07.126055 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b4cbd40d-fa09-4c90-a2f2-ef375b72cbfa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:07.126501 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b4cbd40d-fa09-4c90-a2f2-ef375b72cbfa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:07.127682 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b4cbd40d-fa09-4c90-a2f2-ef375b72cbfa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:07.128126 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b4cbd40d-fa09-4c90-a2f2-ef375b72cbfa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:07.265411 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-b4cbd40d-fa09-4c90-a2f2-ef375b72cbfa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:07.274463 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-b4cbd40d-fa09-4c90-a2f2-ef375b72cbfa tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.159520 Apr 11 16:38:07.275037 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 163/339] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:07 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:08.292026 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-02d5efe7-84e3-4d84-bf24-0a15620e33c1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:08.292596 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-02d5efe7-84e3-4d84-bf24-0a15620e33c1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:08.299028 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-02d5efe7-84e3-4d84-bf24-0a15620e33c1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:08.299463 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-02d5efe7-84e3-4d84-bf24-0a15620e33c1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:08.300230 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-02d5efe7-84e3-4d84-bf24-0a15620e33c1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:08.300678 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-02d5efe7-84e3-4d84-bf24-0a15620e33c1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:08.436655 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-02d5efe7-84e3-4d84-bf24-0a15620e33c1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:08.444065 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-02d5efe7-84e3-4d84-bf24-0a15620e33c1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.155885 Apr 11 16:38:08.444622 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 177/340] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:08 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:09.463293 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e7ec021c-8235-4e4b-add1-98bcc602ed2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:09.463949 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e7ec021c-8235-4e4b-add1-98bcc602ed2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:09.470755 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e7ec021c-8235-4e4b-add1-98bcc602ed2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:09.471489 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e7ec021c-8235-4e4b-add1-98bcc602ed2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:09.472314 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e7ec021c-8235-4e4b-add1-98bcc602ed2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:09.472752 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e7ec021c-8235-4e4b-add1-98bcc602ed2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:09.605389 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e7ec021c-8235-4e4b-add1-98bcc602ed2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:09.613322 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e7ec021c-8235-4e4b-add1-98bcc602ed2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.153836 Apr 11 16:38:09.613897 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 164/341] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:09 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:10.630696 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-6d38aaee-ce30-4459-8256-623f433008ae tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:10.631272 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-6d38aaee-ce30-4459-8256-623f433008ae tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:10.637875 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6d38aaee-ce30-4459-8256-623f433008ae tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:10.638311 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6d38aaee-ce30-4459-8256-623f433008ae tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:10.639067 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6d38aaee-ce30-4459-8256-623f433008ae tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:10.639484 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6d38aaee-ce30-4459-8256-623f433008ae tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:10.769042 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6d38aaee-ce30-4459-8256-623f433008ae tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:10.776950 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-6d38aaee-ce30-4459-8256-623f433008ae tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.150473 Apr 11 16:38:10.777890 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 178/342] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:10 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:11.794893 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5e6cc5aa-9e33-44fc-9ef1-37274c2fccec tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:11.795475 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5e6cc5aa-9e33-44fc-9ef1-37274c2fccec tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:11.802588 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5e6cc5aa-9e33-44fc-9ef1-37274c2fccec tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:11.803034 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5e6cc5aa-9e33-44fc-9ef1-37274c2fccec tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:11.803859 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5e6cc5aa-9e33-44fc-9ef1-37274c2fccec tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:11.804284 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5e6cc5aa-9e33-44fc-9ef1-37274c2fccec tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:11.936211 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5e6cc5aa-9e33-44fc-9ef1-37274c2fccec tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:11.944687 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5e6cc5aa-9e33-44fc-9ef1-37274c2fccec tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.153747 Apr 11 16:38:11.945329 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 165/343] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:11 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:12.963403 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-4e004c0b-98e8-4efd-a397-853030bdb457 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:12.964014 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-4e004c0b-98e8-4efd-a397-853030bdb457 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:12.970516 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4e004c0b-98e8-4efd-a397-853030bdb457 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:12.970958 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4e004c0b-98e8-4efd-a397-853030bdb457 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:12.971751 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4e004c0b-98e8-4efd-a397-853030bdb457 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:12.972183 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4e004c0b-98e8-4efd-a397-853030bdb457 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:13.107349 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-4e004c0b-98e8-4efd-a397-853030bdb457 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:13.115347 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-4e004c0b-98e8-4efd-a397-853030bdb457 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.155901 Apr 11 16:38:13.115976 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 179/344] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:12 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:14.133006 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-56474964-58f8-4fd0-9ef4-6df08c052a44 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:14.133574 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-56474964-58f8-4fd0-9ef4-6df08c052a44 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:14.140583 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-56474964-58f8-4fd0-9ef4-6df08c052a44 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:14.141026 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-56474964-58f8-4fd0-9ef4-6df08c052a44 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:14.141788 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-56474964-58f8-4fd0-9ef4-6df08c052a44 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:14.142207 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-56474964-58f8-4fd0-9ef4-6df08c052a44 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:14.279803 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-56474964-58f8-4fd0-9ef4-6df08c052a44 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:14.288053 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-56474964-58f8-4fd0-9ef4-6df08c052a44 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.158876 Apr 11 16:38:14.288552 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 166/345] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:14 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:15.308062 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ee6cd947-4f52-4095-80f8-6a228953d972 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:15.308881 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ee6cd947-4f52-4095-80f8-6a228953d972 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:15.315244 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ee6cd947-4f52-4095-80f8-6a228953d972 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:15.315763 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ee6cd947-4f52-4095-80f8-6a228953d972 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:15.316535 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ee6cd947-4f52-4095-80f8-6a228953d972 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:15.316967 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ee6cd947-4f52-4095-80f8-6a228953d972 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:15.446347 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ee6cd947-4f52-4095-80f8-6a228953d972 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:15.453644 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ee6cd947-4f52-4095-80f8-6a228953d972 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.151879 Apr 11 16:38:15.454211 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 180/346] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:15 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:16.470831 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-0572aae4-da18-4c61-9d7b-02abe67de117 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:16.471507 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-0572aae4-da18-4c61-9d7b-02abe67de117 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:16.478347 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0572aae4-da18-4c61-9d7b-02abe67de117 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:16.478799 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0572aae4-da18-4c61-9d7b-02abe67de117 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:16.479595 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0572aae4-da18-4c61-9d7b-02abe67de117 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:16.480057 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0572aae4-da18-4c61-9d7b-02abe67de117 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:16.702985 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0572aae4-da18-4c61-9d7b-02abe67de117 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:16.711198 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-0572aae4-da18-4c61-9d7b-02abe67de117 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.244463 Apr 11 16:38:16.711794 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 167/347] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:16 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:17.727658 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1dc528a6-12fb-4d6e-b0a9-37f383bcfc6a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:17.728279 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1dc528a6-12fb-4d6e-b0a9-37f383bcfc6a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:17.734694 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1dc528a6-12fb-4d6e-b0a9-37f383bcfc6a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:17.735147 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1dc528a6-12fb-4d6e-b0a9-37f383bcfc6a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:17.736013 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1dc528a6-12fb-4d6e-b0a9-37f383bcfc6a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:17.736442 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1dc528a6-12fb-4d6e-b0a9-37f383bcfc6a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:17.868446 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1dc528a6-12fb-4d6e-b0a9-37f383bcfc6a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:17.876003 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1dc528a6-12fb-4d6e-b0a9-37f383bcfc6a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1500 microversion: 2.1 time: 0.152198 Apr 11 16:38:17.876633 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 181/348] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:17 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1500 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:17.892699 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-9dae4f6d-9d1f-4ae5-a3c2-507ac42abc0f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76fa3d07-3f93-4e84-b74c-6912c048dd13"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:38:17.893787 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-9dae4f6d-9d1f-4ae5-a3c2-507ac42abc0f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:17.900273 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9dae4f6d-9d1f-4ae5-a3c2-507ac42abc0f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:17.900658 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9dae4f6d-9d1f-4ae5-a3c2-507ac42abc0f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:17.901421 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9dae4f6d-9d1f-4ae5-a3c2-507ac42abc0f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:17.901848 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9dae4f6d-9d1f-4ae5-a3c2-507ac42abc0f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:17.924348 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-9dae4f6d-9d1f-4ae5-a3c2-507ac42abc0f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] HTTP exception thrown: Cannot 'attach_volume' instance a3dc4a3c-61a6-4e27-af48-37b52aa6a959 while it is in vm_state rescued Apr 11 16:38:17.924946 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-9dae4f6d-9d1f-4ae5-a3c2-507ac42abc0f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Returning 409 to user: Cannot 'attach_volume' instance a3dc4a3c-61a6-4e27-af48-37b52aa6a959 while it is in vm_state rescued {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:38:17.925798 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-9dae4f6d-9d1f-4ae5-a3c2-507ac42abc0f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "POST /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.037267 Apr 11 16:38:17.926510 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 168/349] 10.222.0.65 () {60 vars in 1322 bytes} [Mon Apr 11 16:38:17 2022] POST /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959/os-volume_attachments => generated 152 bytes in 38 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 11 16:38:17.935044 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-fea65cb4-45c4-46fb-a3b0-8e3e1d4c58ea tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:38:17.935579 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-fea65cb4-45c4-46fb-a3b0-8e3e1d4c58ea tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:17.941865 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fea65cb4-45c4-46fb-a3b0-8e3e1d4c58ea tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:17.942312 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fea65cb4-45c4-46fb-a3b0-8e3e1d4c58ea tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:17.943075 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fea65cb4-45c4-46fb-a3b0-8e3e1d4c58ea tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:17.943512 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fea65cb4-45c4-46fb-a3b0-8e3e1d4c58ea tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:18.011781 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-fea65cb4-45c4-46fb-a3b0-8e3e1d4c58ea tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "POST /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959/action" status: 202 len: 0 microversion: 2.1 time: 0.080403 Apr 11 16:38:18.014144 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 182/350] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Apr 11 16:38:17 2022] POST /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:38:18.020510 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-4fee7b42-ffbe-40a9-8ea5-102ee29a2f9e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:18.021117 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-4fee7b42-ffbe-40a9-8ea5-102ee29a2f9e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:18.027797 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4fee7b42-ffbe-40a9-8ea5-102ee29a2f9e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:18.028247 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4fee7b42-ffbe-40a9-8ea5-102ee29a2f9e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:18.029016 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4fee7b42-ffbe-40a9-8ea5-102ee29a2f9e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:18.029444 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4fee7b42-ffbe-40a9-8ea5-102ee29a2f9e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:18.163952 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-4fee7b42-ffbe-40a9-8ea5-102ee29a2f9e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:18.171376 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-4fee7b42-ffbe-40a9-8ea5-102ee29a2f9e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1508 microversion: 2.1 time: 0.154678 Apr 11 16:38:18.171985 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 169/351] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:18 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:19.189991 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-64ecff27-aab7-4067-a1b8-7154e9eed661 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:19.190743 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-64ecff27-aab7-4067-a1b8-7154e9eed661 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:19.197441 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-64ecff27-aab7-4067-a1b8-7154e9eed661 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:19.197877 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-64ecff27-aab7-4067-a1b8-7154e9eed661 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:19.198628 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-64ecff27-aab7-4067-a1b8-7154e9eed661 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:19.199050 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-64ecff27-aab7-4067-a1b8-7154e9eed661 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:19.327891 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-64ecff27-aab7-4067-a1b8-7154e9eed661 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:19.335297 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-64ecff27-aab7-4067-a1b8-7154e9eed661 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1508 microversion: 2.1 time: 0.149618 Apr 11 16:38:19.335896 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 183/352] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:19 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:20.352872 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5cd5bac9-bace-4c47-966e-4f2e1006f995 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:20.353476 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5cd5bac9-bace-4c47-966e-4f2e1006f995 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:20.360345 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5cd5bac9-bace-4c47-966e-4f2e1006f995 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:20.360793 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5cd5bac9-bace-4c47-966e-4f2e1006f995 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:20.361845 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5cd5bac9-bace-4c47-966e-4f2e1006f995 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:20.362328 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5cd5bac9-bace-4c47-966e-4f2e1006f995 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:20.490621 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5cd5bac9-bace-4c47-966e-4f2e1006f995 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:20.498735 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5cd5bac9-bace-4c47-966e-4f2e1006f995 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1508 microversion: 2.1 time: 0.149960 Apr 11 16:38:20.499326 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 170/353] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:20 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:21.516451 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-43b3bc46-034d-4e09-a6c2-4031b0a59a2e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:21.517227 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-43b3bc46-034d-4e09-a6c2-4031b0a59a2e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:21.523269 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-43b3bc46-034d-4e09-a6c2-4031b0a59a2e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:21.524006 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-43b3bc46-034d-4e09-a6c2-4031b0a59a2e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:21.524769 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-43b3bc46-034d-4e09-a6c2-4031b0a59a2e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:21.525498 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-43b3bc46-034d-4e09-a6c2-4031b0a59a2e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:21.764164 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-43b3bc46-034d-4e09-a6c2-4031b0a59a2e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:21.772038 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-43b3bc46-034d-4e09-a6c2-4031b0a59a2e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1508 microversion: 2.1 time: 0.259433 Apr 11 16:38:21.773038 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 184/354] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:21 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:22.789642 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ce654ca3-4f5a-4800-b673-d9f9bd256b32 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:22.790322 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ce654ca3-4f5a-4800-b673-d9f9bd256b32 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:22.797216 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ce654ca3-4f5a-4800-b673-d9f9bd256b32 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:22.797654 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ce654ca3-4f5a-4800-b673-d9f9bd256b32 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:22.798597 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ce654ca3-4f5a-4800-b673-d9f9bd256b32 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:22.799022 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ce654ca3-4f5a-4800-b673-d9f9bd256b32 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:22.928395 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ce654ca3-4f5a-4800-b673-d9f9bd256b32 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:22.936096 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ce654ca3-4f5a-4800-b673-d9f9bd256b32 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1508 microversion: 2.1 time: 0.150311 Apr 11 16:38:22.936676 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 171/355] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:22 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:23.953769 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-a9497be0-0e19-4b89-ad52-9769fafd2bd3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:23.954379 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-a9497be0-0e19-4b89-ad52-9769fafd2bd3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:23.960938 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a9497be0-0e19-4b89-ad52-9769fafd2bd3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:23.961372 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a9497be0-0e19-4b89-ad52-9769fafd2bd3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:23.962126 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a9497be0-0e19-4b89-ad52-9769fafd2bd3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:23.962540 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a9497be0-0e19-4b89-ad52-9769fafd2bd3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:24.094968 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-a9497be0-0e19-4b89-ad52-9769fafd2bd3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:24.104847 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-a9497be0-0e19-4b89-ad52-9769fafd2bd3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1508 microversion: 2.1 time: 0.155032 Apr 11 16:38:24.105420 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 185/356] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:23 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:25.121661 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-183d5d25-6598-420e-8276-1a9f91b822eb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:25.122288 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-183d5d25-6598-420e-8276-1a9f91b822eb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:25.130176 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-183d5d25-6598-420e-8276-1a9f91b822eb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:25.130612 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-183d5d25-6598-420e-8276-1a9f91b822eb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:25.131354 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-183d5d25-6598-420e-8276-1a9f91b822eb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:25.131804 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-183d5d25-6598-420e-8276-1a9f91b822eb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:25.259990 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-183d5d25-6598-420e-8276-1a9f91b822eb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:25.272344 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-183d5d25-6598-420e-8276-1a9f91b822eb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1508 microversion: 2.1 time: 0.154753 Apr 11 16:38:25.273068 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 172/357] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:25 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:26.289852 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-9e8f3b06-8ea4-4470-9ecf-e1e0f1867686 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:26.290430 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-9e8f3b06-8ea4-4470-9ecf-e1e0f1867686 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:26.297524 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9e8f3b06-8ea4-4470-9ecf-e1e0f1867686 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:26.297945 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9e8f3b06-8ea4-4470-9ecf-e1e0f1867686 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:26.298727 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9e8f3b06-8ea4-4470-9ecf-e1e0f1867686 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:26.299236 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9e8f3b06-8ea4-4470-9ecf-e1e0f1867686 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:26.437200 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9e8f3b06-8ea4-4470-9ecf-e1e0f1867686 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:26.448166 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-9e8f3b06-8ea4-4470-9ecf-e1e0f1867686 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1508 microversion: 2.1 time: 0.162126 Apr 11 16:38:26.448760 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 186/358] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:26 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:27.466864 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-6b90b869-fcd0-4cd4-bb22-f2d5b1873041 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:27.467438 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-6b90b869-fcd0-4cd4-bb22-f2d5b1873041 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:27.474984 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6b90b869-fcd0-4cd4-bb22-f2d5b1873041 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:27.475433 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6b90b869-fcd0-4cd4-bb22-f2d5b1873041 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:27.476239 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6b90b869-fcd0-4cd4-bb22-f2d5b1873041 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:27.476670 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6b90b869-fcd0-4cd4-bb22-f2d5b1873041 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:27.622077 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-6b90b869-fcd0-4cd4-bb22-f2d5b1873041 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:27.631603 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-6b90b869-fcd0-4cd4-bb22-f2d5b1873041 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1508 microversion: 2.1 time: 0.169129 Apr 11 16:38:27.632227 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 173/359] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:27 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:28.649210 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-bf96cc6f-df89-42ca-a37f-c2d50ac41f3f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:28.649774 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-bf96cc6f-df89-42ca-a37f-c2d50ac41f3f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:28.656312 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bf96cc6f-df89-42ca-a37f-c2d50ac41f3f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:28.656791 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bf96cc6f-df89-42ca-a37f-c2d50ac41f3f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:28.657921 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bf96cc6f-df89-42ca-a37f-c2d50ac41f3f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:28.658447 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bf96cc6f-df89-42ca-a37f-c2d50ac41f3f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:28.788079 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-bf96cc6f-df89-42ca-a37f-c2d50ac41f3f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:28.796051 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-bf96cc6f-df89-42ca-a37f-c2d50ac41f3f tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1508 microversion: 2.1 time: 0.150908 Apr 11 16:38:28.796610 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 187/360] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:28 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:29.814100 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-fed10a9b-6665-4340-a94b-3422607c4aa3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:29.814868 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-fed10a9b-6665-4340-a94b-3422607c4aa3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:29.821466 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fed10a9b-6665-4340-a94b-3422607c4aa3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:29.821904 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fed10a9b-6665-4340-a94b-3422607c4aa3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:29.822668 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fed10a9b-6665-4340-a94b-3422607c4aa3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:29.823089 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fed10a9b-6665-4340-a94b-3422607c4aa3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:29.956596 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-fed10a9b-6665-4340-a94b-3422607c4aa3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:29.964521 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-fed10a9b-6665-4340-a94b-3422607c4aa3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1514 microversion: 2.1 time: 0.154441 Apr 11 16:38:29.965099 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 174/361] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:29 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:35.663232 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-81c95254-9b24-4774-9a40-f0ec41a7d3b1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Action: 'create', calling method: .version_select at 0x7f741825a820>, body: {"keypair": {"name": "tempest-keypair-1405398358"}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:38:35.683278 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-81c95254-9b24-4774-9a40-f0ec41a7d3b1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Getting quotas for project e396e5cb51e143bb84d76c18dba0d403. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:38:35.687158 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-81c95254-9b24-4774-9a40-f0ec41a7d3b1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Getting quotas for user 80a6cb4479a746b2928b5948282f9d54 and project e396e5cb51e143bb84d76c18dba0d403. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:38:36.064897 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-81c95254-9b24-4774-9a40-f0ec41a7d3b1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Getting quotas for project e396e5cb51e143bb84d76c18dba0d403. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:38:36.069154 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-81c95254-9b24-4774-9a40-f0ec41a7d3b1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Getting quotas for user 80a6cb4479a746b2928b5948282f9d54 and project e396e5cb51e143bb84d76c18dba0d403. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:38:36.083143 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-81c95254-9b24-4774-9a40-f0ec41a7d3b1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.423680 Apr 11 16:38:36.087828 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 188/362] 10.222.0.65 () {60 vars in 1157 bytes} [Mon Apr 11 16:38:35 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:37.581371 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-36632c50-acfb-4e80-b36c-a01519827687 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-397881499", "imageRef": "e989c938-7b7a-445c-aec9-596e81d35104", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "beb37b89-3aa6-44d9-a704-52e8c05a205a"}], "security_groups": [{"name": "tempest-securitygroup--2079676714"}], "key_name": "tempest-keypair-1405398358", "user_data": "}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:38:37.740668 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.network.neutron [None req-36632c50-acfb-4e80-b36c-a01519827687 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] validate_networks() for [('beb37b89-3aa6-44d9-a704-52e8c05a205a', None, None, None, None, None)] {{(pid=123774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:38:38.446828 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-36632c50-acfb-4e80-b36c-a01519827687 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Flavor limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:38:38.448564 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-36632c50-acfb-4e80-b36c-a01519827687 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Image limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:38:38.452533 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-36632c50-acfb-4e80-b36c-a01519827687 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Flavor pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:38:38.453499 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-36632c50-acfb-4e80-b36c-a01519827687 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Image pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:38:38.454591 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-36632c50-acfb-4e80-b36c-a01519827687 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:38:38.473053 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-36632c50-acfb-4e80-b36c-a01519827687 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:38.473955 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-36632c50-acfb-4e80-b36c-a01519827687 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:38.476297 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-36632c50-acfb-4e80-b36c-a01519827687 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:38.478061 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-36632c50-acfb-4e80-b36c-a01519827687 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:38.520869 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-36632c50-acfb-4e80-b36c-a01519827687 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Getting quotas for project e396e5cb51e143bb84d76c18dba0d403. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:38:38.533642 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-36632c50-acfb-4e80-b36c-a01519827687 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Getting quotas for user 80a6cb4479a746b2928b5948282f9d54 and project e396e5cb51e143bb84d76c18dba0d403. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:38:38.557941 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-36632c50-acfb-4e80-b36c-a01519827687 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Going to run 1 instances... {{(pid=123774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:38:38.564365 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-36632c50-acfb-4e80-b36c-a01519827687 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e989c938-7b7a-445c-aec9-596e81d35104',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:38:38.681379 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: ERROR oslo.messaging._drivers.impl_rabbit [None req-36632c50-acfb-4e80-b36c-a01519827687 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [f04b7b86-6245-45ca-9742-98d2000d17f2] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 16:38:39.690652 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO oslo.messaging._drivers.impl_rabbit [None req-36632c50-acfb-4e80-b36c-a01519827687 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [f04b7b86-6245-45ca-9742-98d2000d17f2] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59564. Apr 11 16:38:39.695454 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-36632c50-acfb-4e80-b36c-a01519827687 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.122131 Apr 11 16:38:39.702294 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 175/363] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Apr 11 16:38:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 2130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 16:38:39.718207 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-cc9abec5-d150-4ad5-89d1-5386949b0471 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:39.719263 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-cc9abec5-d150-4ad5-89d1-5386949b0471 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:39.784697 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-cc9abec5-d150-4ad5-89d1-5386949b0471 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:39.797315 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-cc9abec5-d150-4ad5-89d1-5386949b0471 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1245 microversion: 2.1 time: 0.093095 Apr 11 16:38:39.797600 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 189/364] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:39 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:38:40.816319 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-0200908f-ce45-48e7-a301-d7f64ddbb380 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:40.817575 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-0200908f-ce45-48e7-a301-d7f64ddbb380 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:40.936996 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0200908f-ce45-48e7-a301-d7f64ddbb380 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:40.947567 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-0200908f-ce45-48e7-a301-d7f64ddbb380 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1245 microversion: 2.1 time: 0.136618 Apr 11 16:38:40.948484 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 176/365] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:40 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1245 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:38:41.973084 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-4977b1ac-c990-449a-8f04-2cbfc5bf7ca3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:41.974913 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-4977b1ac-c990-449a-8f04-2cbfc5bf7ca3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:42.092952 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-4977b1ac-c990-449a-8f04-2cbfc5bf7ca3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:42.112919 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-4977b1ac-c990-449a-8f04-2cbfc5bf7ca3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1245 microversion: 2.1 time: 0.145981 Apr 11 16:38:42.116267 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 190/366] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:41 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1245 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:38:43.141309 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ef012ed8-a8cf-4d54-a73d-68afdaf36a87 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:43.142255 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ef012ed8-a8cf-4d54-a73d-68afdaf36a87 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:43.212106 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ef012ed8-a8cf-4d54-a73d-68afdaf36a87 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:43.223688 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ef012ed8-a8cf-4d54-a73d-68afdaf36a87 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1245 microversion: 2.1 time: 0.088595 Apr 11 16:38:43.227588 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 177/367] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:43 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:44.247415 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-9132bd1c-398b-402c-8e0f-1690ebfeb967 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:44.248065 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-9132bd1c-398b-402c-8e0f-1690ebfeb967 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:44.258259 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9132bd1c-398b-402c-8e0f-1690ebfeb967 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:44.259011 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9132bd1c-398b-402c-8e0f-1690ebfeb967 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:44.260322 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9132bd1c-398b-402c-8e0f-1690ebfeb967 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:44.261054 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9132bd1c-398b-402c-8e0f-1690ebfeb967 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:44.561286 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9132bd1c-398b-402c-8e0f-1690ebfeb967 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:44.575954 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-9132bd1c-398b-402c-8e0f-1690ebfeb967 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1249 microversion: 2.1 time: 0.331785 Apr 11 16:38:44.577006 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 191/368] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:44 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1249 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:38:45.595316 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-21271318-1dc8-4fda-bc38-4ec76ae899bb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:45.596740 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-21271318-1dc8-4fda-bc38-4ec76ae899bb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:45.606759 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-21271318-1dc8-4fda-bc38-4ec76ae899bb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:45.607574 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-21271318-1dc8-4fda-bc38-4ec76ae899bb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:45.609017 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-21271318-1dc8-4fda-bc38-4ec76ae899bb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:45.610277 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-21271318-1dc8-4fda-bc38-4ec76ae899bb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:45.684487 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-21271318-1dc8-4fda-bc38-4ec76ae899bb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:45.693947 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-21271318-1dc8-4fda-bc38-4ec76ae899bb tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1249 microversion: 2.1 time: 0.104504 Apr 11 16:38:45.703981 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 178/369] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:45 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1249 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:46.712910 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-a33c6895-6120-41ca-91d9-19edeb16ffa8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:46.713941 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-a33c6895-6120-41ca-91d9-19edeb16ffa8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:46.738696 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a33c6895-6120-41ca-91d9-19edeb16ffa8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:46.739450 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a33c6895-6120-41ca-91d9-19edeb16ffa8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:46.740979 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a33c6895-6120-41ca-91d9-19edeb16ffa8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:46.741937 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a33c6895-6120-41ca-91d9-19edeb16ffa8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:46.872652 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-a33c6895-6120-41ca-91d9-19edeb16ffa8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:46.886052 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-a33c6895-6120-41ca-91d9-19edeb16ffa8 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1249 microversion: 2.1 time: 0.179110 Apr 11 16:38:46.887364 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 192/370] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:46 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1249 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:47.904345 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-8fb2e43c-0ec2-4762-aef7-d41614f7f55e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:47.905521 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-8fb2e43c-0ec2-4762-aef7-d41614f7f55e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:47.913965 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8fb2e43c-0ec2-4762-aef7-d41614f7f55e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:47.914403 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8fb2e43c-0ec2-4762-aef7-d41614f7f55e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:47.915180 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8fb2e43c-0ec2-4762-aef7-d41614f7f55e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:47.915602 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8fb2e43c-0ec2-4762-aef7-d41614f7f55e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:48.014726 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8fb2e43c-0ec2-4762-aef7-d41614f7f55e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:48.022756 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-8fb2e43c-0ec2-4762-aef7-d41614f7f55e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1241 microversion: 2.1 time: 0.122329 Apr 11 16:38:48.023990 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 179/371] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:47 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1241 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:49.065054 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-4c40f8e8-dbd8-488a-8e20-92209a1dca24 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:49.072141 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-4c40f8e8-dbd8-488a-8e20-92209a1dca24 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:49.100180 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4c40f8e8-dbd8-488a-8e20-92209a1dca24 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:49.103569 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4c40f8e8-dbd8-488a-8e20-92209a1dca24 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:49.106749 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4c40f8e8-dbd8-488a-8e20-92209a1dca24 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:49.108704 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4c40f8e8-dbd8-488a-8e20-92209a1dca24 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:49.280101 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-4c40f8e8-dbd8-488a-8e20-92209a1dca24 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:49.289516 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-4c40f8e8-dbd8-488a-8e20-92209a1dca24 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1305 microversion: 2.1 time: 0.249561 Apr 11 16:38:49.300790 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 193/372] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:49 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1305 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:50.313111 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-eb4c8238-d658-425d-bda0-5deab65393dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:50.315146 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-eb4c8238-d658-425d-bda0-5deab65393dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:50.325217 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-eb4c8238-d658-425d-bda0-5deab65393dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:50.326110 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-eb4c8238-d658-425d-bda0-5deab65393dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:50.327301 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-eb4c8238-d658-425d-bda0-5deab65393dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:50.328034 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-eb4c8238-d658-425d-bda0-5deab65393dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:50.464002 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-eb4c8238-d658-425d-bda0-5deab65393dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:50.474758 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-eb4c8238-d658-425d-bda0-5deab65393dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1303 microversion: 2.1 time: 0.168526 Apr 11 16:38:50.485457 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 180/373] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:50 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1303 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:51.329149 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:38:51.329853 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: Mon Apr 11 16:38:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 16:38:51.493567 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-db749c7f-9e9f-47d1-9653-53dc6135153c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:51.494743 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-db749c7f-9e9f-47d1-9653-53dc6135153c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:51.514187 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-db749c7f-9e9f-47d1-9653-53dc6135153c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:51.515039 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-db749c7f-9e9f-47d1-9653-53dc6135153c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:51.518798 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-db749c7f-9e9f-47d1-9653-53dc6135153c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:51.519294 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-db749c7f-9e9f-47d1-9653-53dc6135153c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:51.885022 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-75928f6a-30af-4f04-9552-af7524fc2c52 req-15aa938f-c659-467e-84a5-56aa41a62766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b8c15a9-44fe-41af-affd-6ea36d214007", "tag": "851afbae-5cd1-4945-b6c6-66059ebc4234"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:38:51.925904 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-75928f6a-30af-4f04-9552-af7524fc2c52 req-15aa938f-c659-467e-84a5-56aa41a62766 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:51.926346 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-75928f6a-30af-4f04-9552-af7524fc2c52 req-15aa938f-c659-467e-84a5-56aa41a62766 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:51.935260 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-db749c7f-9e9f-47d1-9653-53dc6135153c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:51.947214 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-75928f6a-30af-4f04-9552-af7524fc2c52 req-15aa938f-c659-467e-84a5-56aa41a62766 service nova] Creating event network-changed:851afbae-5cd1-4945-b6c6-66059ebc4234 for instance 2b8c15a9-44fe-41af-affd-6ea36d214007 on hv-cinder-83716 Apr 11 16:38:51.965281 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-db749c7f-9e9f-47d1-9653-53dc6135153c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1371 microversion: 2.1 time: 0.476719 Apr 11 16:38:51.966331 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 194/374] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:51 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1371 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:51.976018 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-75928f6a-30af-4f04-9552-af7524fc2c52 req-15aa938f-c659-467e-84a5-56aa41a62766 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084510 Apr 11 16:38:51.977011 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 181/375] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:38:52.338548 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1991a651-b0ef-4513-a511-9c42e77095d3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1893915517", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1532288997", "security_groups": [{"name": "tempest-secgroup-smoke-1006094679"}], "networks": [{"uuid": "95376780-017d-49c0-855d-5ff4d91f3fdf"}], "block_device_mapping_v2": [{"uuid": "cc83de8d-6412-4f9f-9b00-475d30dd885a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:38:52.729679 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.network.neutron [None req-1991a651-b0ef-4513-a511-9c42e77095d3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] validate_networks() for [('95376780-017d-49c0-855d-5ff4d91f3fdf', None, None, None, None, None)] {{(pid=123773) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:38:52.983729 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e879106a-f123-40c8-9ec8-8d780d75cbb0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:52.985930 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e879106a-f123-40c8-9ec8-8d780d75cbb0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:53.007312 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e879106a-f123-40c8-9ec8-8d780d75cbb0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:53.010475 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e879106a-f123-40c8-9ec8-8d780d75cbb0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:53.012783 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e879106a-f123-40c8-9ec8-8d780d75cbb0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:53.013279 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e879106a-f123-40c8-9ec8-8d780d75cbb0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:53.420636 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e879106a-f123-40c8-9ec8-8d780d75cbb0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:53.433608 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e879106a-f123-40c8-9ec8-8d780d75cbb0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1371 microversion: 2.1 time: 0.454659 Apr 11 16:38:53.448165 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 182/376] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:52 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1371 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:38:53.656663 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-1991a651-b0ef-4513-a511-9c42e77095d3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Flavor limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:38:53.657266 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-1991a651-b0ef-4513-a511-9c42e77095d3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Image limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:38:53.657699 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-1991a651-b0ef-4513-a511-9c42e77095d3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Flavor pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:38:53.658649 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-1991a651-b0ef-4513-a511-9c42e77095d3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Image pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:38:53.659090 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-1991a651-b0ef-4513-a511-9c42e77095d3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:38:53.671115 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1991a651-b0ef-4513-a511-9c42e77095d3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:53.672082 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1991a651-b0ef-4513-a511-9c42e77095d3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:53.673949 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1991a651-b0ef-4513-a511-9c42e77095d3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:53.674621 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1991a651-b0ef-4513-a511-9c42e77095d3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:53.698382 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-1991a651-b0ef-4513-a511-9c42e77095d3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Getting quotas for project 0ad65af0201c40fea0218125fd073de1. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:38:53.707375 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-1991a651-b0ef-4513-a511-9c42e77095d3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Getting quotas for user d6976dcc895e45bf8421ebab360a9536 and project 0ad65af0201c40fea0218125fd073de1. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:38:53.800010 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1991a651-b0ef-4513-a511-9c42e77095d3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Going to run 1 instances... {{(pid=123773) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:38:53.823304 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1991a651-b0ef-4513-a511-9c42e77095d3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cc83de8d-6412-4f9f-9b00-475d30dd885a',volume_size=None,volume_type=None)] {{(pid=123773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:38:54.077893 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1991a651-b0ef-4513-a511-9c42e77095d3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.750485 Apr 11 16:38:54.079653 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 195/377] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Apr 11 16:38:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 16:38:54.092578 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-44a29195-9ae8-482c-92ed-b0cc3f26b635 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:54.093283 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-44a29195-9ae8-482c-92ed-b0cc3f26b635 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:54.250195 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-44a29195-9ae8-482c-92ed-b0cc3f26b635 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:54.267954 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-44a29195-9ae8-482c-92ed-b0cc3f26b635 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1089 microversion: 2.1 time: 0.176512 Apr 11 16:38:54.286333 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 183/378] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:54 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1089 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:54.457853 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-5ecc1be5-cf8b-4a81-9a24-633f2accf6dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:54.459233 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-5ecc1be5-cf8b-4a81-9a24-633f2accf6dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:54.476852 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5ecc1be5-cf8b-4a81-9a24-633f2accf6dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:54.477957 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5ecc1be5-cf8b-4a81-9a24-633f2accf6dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:54.479557 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5ecc1be5-cf8b-4a81-9a24-633f2accf6dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:54.480549 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5ecc1be5-cf8b-4a81-9a24-633f2accf6dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:54.906411 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5ecc1be5-cf8b-4a81-9a24-633f2accf6dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:54.927268 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-5ecc1be5-cf8b-4a81-9a24-633f2accf6dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1371 microversion: 2.1 time: 0.479314 Apr 11 16:38:54.927958 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 196/379] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:54 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1371 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:55.297483 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f68bbb12-b5b3-4798-bdc2-98eca3e47139 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:55.298816 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f68bbb12-b5b3-4798-bdc2-98eca3e47139 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:55.308291 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f68bbb12-b5b3-4798-bdc2-98eca3e47139 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:55.309018 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f68bbb12-b5b3-4798-bdc2-98eca3e47139 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:55.310362 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f68bbb12-b5b3-4798-bdc2-98eca3e47139 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:55.311109 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f68bbb12-b5b3-4798-bdc2-98eca3e47139 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:55.407478 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f68bbb12-b5b3-4798-bdc2-98eca3e47139 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:55.424604 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f68bbb12-b5b3-4798-bdc2-98eca3e47139 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1139 microversion: 2.1 time: 0.131469 Apr 11 16:38:55.425737 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 184/380] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:55 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1139 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:55.944600 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d022d479-1633-4006-9b23-2918f06f09b0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:55.945458 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d022d479-1633-4006-9b23-2918f06f09b0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:55.957038 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d022d479-1633-4006-9b23-2918f06f09b0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:55.957634 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d022d479-1633-4006-9b23-2918f06f09b0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:55.958497 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d022d479-1633-4006-9b23-2918f06f09b0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:55.959157 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d022d479-1633-4006-9b23-2918f06f09b0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:56.443054 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ddf0ec3c-ffdc-425a-9569-9449603947f5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:56.444002 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ddf0ec3c-ffdc-425a-9569-9449603947f5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:56.474082 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ddf0ec3c-ffdc-425a-9569-9449603947f5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:56.474939 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ddf0ec3c-ffdc-425a-9569-9449603947f5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:56.479483 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ddf0ec3c-ffdc-425a-9569-9449603947f5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:56.483475 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ddf0ec3c-ffdc-425a-9569-9449603947f5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:56.835936 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ddf0ec3c-ffdc-425a-9569-9449603947f5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:56.850717 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ddf0ec3c-ffdc-425a-9569-9449603947f5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1205 microversion: 2.1 time: 0.411874 Apr 11 16:38:56.851711 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 185/381] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:56 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1205 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:38:56.965826 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d022d479-1633-4006-9b23-2918f06f09b0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:56.993286 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d022d479-1633-4006-9b23-2918f06f09b0 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1371 microversion: 2.1 time: 1.050732 Apr 11 16:38:57.003195 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 197/382] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:55 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1371 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:57.871174 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-4efdeaeb-21cc-47ae-8b81-9bc2cd37c869 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:57.871875 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-4efdeaeb-21cc-47ae-8b81-9bc2cd37c869 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:57.883975 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4efdeaeb-21cc-47ae-8b81-9bc2cd37c869 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:57.889905 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4efdeaeb-21cc-47ae-8b81-9bc2cd37c869 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:57.891628 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4efdeaeb-21cc-47ae-8b81-9bc2cd37c869 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:57.892307 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4efdeaeb-21cc-47ae-8b81-9bc2cd37c869 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:58.012211 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-a8c27dc3-707a-4e3d-ae08-a73745ab6aa5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:58.012898 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-a8c27dc3-707a-4e3d-ae08-a73745ab6aa5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:58.034238 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a8c27dc3-707a-4e3d-ae08-a73745ab6aa5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:58.036194 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a8c27dc3-707a-4e3d-ae08-a73745ab6aa5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:58.048718 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-4efdeaeb-21cc-47ae-8b81-9bc2cd37c869 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:58.049521 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a8c27dc3-707a-4e3d-ae08-a73745ab6aa5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:58.050301 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a8c27dc3-707a-4e3d-ae08-a73745ab6aa5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:58.066392 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-4efdeaeb-21cc-47ae-8b81-9bc2cd37c869 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1193 microversion: 2.1 time: 0.199351 Apr 11 16:38:58.078458 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 186/383] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:57 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1193 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:58.331358 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-a8c27dc3-707a-4e3d-ae08-a73745ab6aa5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:58.356099 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-a8c27dc3-707a-4e3d-ae08-a73745ab6aa5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1371 microversion: 2.1 time: 0.347900 Apr 11 16:38:58.357860 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 198/384] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:58 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1371 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:59.087505 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-9c8cfff0-c1c8-4bcc-9cc0-eb80a1a93fef tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:59.088608 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-9c8cfff0-c1c8-4bcc-9cc0-eb80a1a93fef tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:59.100311 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9c8cfff0-c1c8-4bcc-9cc0-eb80a1a93fef tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:59.101073 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9c8cfff0-c1c8-4bcc-9cc0-eb80a1a93fef tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:59.102753 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9c8cfff0-c1c8-4bcc-9cc0-eb80a1a93fef tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:59.103407 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9c8cfff0-c1c8-4bcc-9cc0-eb80a1a93fef tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:59.257041 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-e119875c-3a0e-4f3d-88cc-2bfbd908f599 req-0d66d72a-3839-4a29-902e-727322ef9b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8c15a9-44fe-41af-affd-6ea36d214007", "name": "network-vif-plugged", "status": "completed", "tag": "851afbae-5cd1-4945-b6c6-66059ebc4234"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:38:59.273918 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-e119875c-3a0e-4f3d-88cc-2bfbd908f599 req-0d66d72a-3839-4a29-902e-727322ef9b6f service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:59.274720 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-e119875c-3a0e-4f3d-88cc-2bfbd908f599 req-0d66d72a-3839-4a29-902e-727322ef9b6f service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:59.289172 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-e119875c-3a0e-4f3d-88cc-2bfbd908f599 req-0d66d72a-3839-4a29-902e-727322ef9b6f service nova] Creating event network-vif-plugged:851afbae-5cd1-4945-b6c6-66059ebc4234 for instance 2b8c15a9-44fe-41af-affd-6ea36d214007 on hv-cinder-83716 Apr 11 16:38:59.297009 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-e119875c-3a0e-4f3d-88cc-2bfbd908f599 req-0d66d72a-3839-4a29-902e-727322ef9b6f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048326 Apr 11 16:38:59.298490 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 199/385] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:38:59.382755 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-14574e76-0aa2-4027-8b5c-aed01582ff5a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:38:59.384022 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-14574e76-0aa2-4027-8b5c-aed01582ff5a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:38:59.391749 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-9c8cfff0-c1c8-4bcc-9cc0-eb80a1a93fef tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:59.407467 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-9c8cfff0-c1c8-4bcc-9cc0-eb80a1a93fef tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.321404 Apr 11 16:38:59.408636 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 187/386] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:59 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:38:59.410123 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-14574e76-0aa2-4027-8b5c-aed01582ff5a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:59.410962 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-14574e76-0aa2-4027-8b5c-aed01582ff5a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:59.412184 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-14574e76-0aa2-4027-8b5c-aed01582ff5a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:38:59.412895 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-14574e76-0aa2-4027-8b5c-aed01582ff5a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:38:59.762146 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-14574e76-0aa2-4027-8b5c-aed01582ff5a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:38:59.775934 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-14574e76-0aa2-4027-8b5c-aed01582ff5a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1371 microversion: 2.1 time: 0.399530 Apr 11 16:38:59.778390 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 200/387] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:38:59 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1371 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:00.147928 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-5800c05f-a2d2-46a1-8bf2-d303bd3d8631 req-fd88bdbb-0324-4902-b84c-55b88e37385b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cccd6eb0-741e-48d1-9539-108d80ff2cad", "tag": "a6f4f255-f8e2-4c79-9875-d58fd39df6bf"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:39:00.173061 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-5800c05f-a2d2-46a1-8bf2-d303bd3d8631 req-fd88bdbb-0324-4902-b84c-55b88e37385b service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:00.174022 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-5800c05f-a2d2-46a1-8bf2-d303bd3d8631 req-fd88bdbb-0324-4902-b84c-55b88e37385b service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:00.197297 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-5800c05f-a2d2-46a1-8bf2-d303bd3d8631 req-fd88bdbb-0324-4902-b84c-55b88e37385b service nova] Creating event network-changed:a6f4f255-f8e2-4c79-9875-d58fd39df6bf for instance cccd6eb0-741e-48d1-9539-108d80ff2cad on hv-cinder-83716 Apr 11 16:39:00.205738 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-5800c05f-a2d2-46a1-8bf2-d303bd3d8631 req-fd88bdbb-0324-4902-b84c-55b88e37385b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071562 Apr 11 16:39:00.207342 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 188/388] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:39:00.456668 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b69494c8-1d3e-4605-999e-26eee3ce9de7 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:00.459945 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b69494c8-1d3e-4605-999e-26eee3ce9de7 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:00.486886 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b69494c8-1d3e-4605-999e-26eee3ce9de7 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:00.488474 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b69494c8-1d3e-4605-999e-26eee3ce9de7 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:00.490824 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b69494c8-1d3e-4605-999e-26eee3ce9de7 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:00.491859 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b69494c8-1d3e-4605-999e-26eee3ce9de7 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:00.699055 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b69494c8-1d3e-4605-999e-26eee3ce9de7 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:00.708137 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b69494c8-1d3e-4605-999e-26eee3ce9de7 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.270687 Apr 11 16:39:00.709082 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 201/389] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:00 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:00.809921 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5ae6cce2-9441-48d9-9c68-6325bbf92301 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:00.811202 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5ae6cce2-9441-48d9-9c68-6325bbf92301 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:00.822102 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5ae6cce2-9441-48d9-9c68-6325bbf92301 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:00.823105 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5ae6cce2-9441-48d9-9c68-6325bbf92301 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:00.824567 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5ae6cce2-9441-48d9-9c68-6325bbf92301 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:00.825335 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5ae6cce2-9441-48d9-9c68-6325bbf92301 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:01.026030 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5ae6cce2-9441-48d9-9c68-6325bbf92301 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:01.048922 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5ae6cce2-9441-48d9-9c68-6325bbf92301 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1371 microversion: 2.1 time: 0.246546 Apr 11 16:39:01.051263 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 189/390] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:00 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:01.743129 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-5ae1e1dd-44f1-44bd-b87d-95d7e81486ba tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:01.744306 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-5ae1e1dd-44f1-44bd-b87d-95d7e81486ba tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:01.757250 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5ae1e1dd-44f1-44bd-b87d-95d7e81486ba tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:01.757764 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5ae1e1dd-44f1-44bd-b87d-95d7e81486ba tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:01.758846 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5ae1e1dd-44f1-44bd-b87d-95d7e81486ba tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:01.759423 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5ae1e1dd-44f1-44bd-b87d-95d7e81486ba tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:01.994695 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5ae1e1dd-44f1-44bd-b87d-95d7e81486ba tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:02.020818 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-5ae1e1dd-44f1-44bd-b87d-95d7e81486ba tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.289422 Apr 11 16:39:02.042937 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 202/391] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:01 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:02.074862 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-23f31fc8-1626-45f4-99e1-3963f102b86e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:02.075729 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-23f31fc8-1626-45f4-99e1-3963f102b86e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:02.087696 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-23f31fc8-1626-45f4-99e1-3963f102b86e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:02.088851 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-23f31fc8-1626-45f4-99e1-3963f102b86e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:02.090454 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-23f31fc8-1626-45f4-99e1-3963f102b86e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:02.091433 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-23f31fc8-1626-45f4-99e1-3963f102b86e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:02.286269 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-23f31fc8-1626-45f4-99e1-3963f102b86e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:02.295691 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-23f31fc8-1626-45f4-99e1-3963f102b86e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1565 microversion: 2.1 time: 0.228363 Apr 11 16:39:02.296296 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 190/392] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:02 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1565 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:02.323310 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c36da5a0-6b12-4637-bc03-87c88d383973 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:02.324702 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c36da5a0-6b12-4637-bc03-87c88d383973 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:02.337457 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c36da5a0-6b12-4637-bc03-87c88d383973 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:02.339474 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c36da5a0-6b12-4637-bc03-87c88d383973 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:02.341335 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c36da5a0-6b12-4637-bc03-87c88d383973 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:02.342545 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c36da5a0-6b12-4637-bc03-87c88d383973 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:02.459519 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c36da5a0-6b12-4637-bc03-87c88d383973 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143432 Apr 11 16:39:02.460630 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 203/393] 10.222.0.65 () {58 vars in 1274 bytes} [Mon Apr 11 16:39:02 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:39:03.047412 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-18fe55e9-75b1-4312-ad0d-c4f0d81a9834 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:03.048067 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-18fe55e9-75b1-4312-ad0d-c4f0d81a9834 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:03.054218 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-18fe55e9-75b1-4312-ad0d-c4f0d81a9834 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:03.054929 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-18fe55e9-75b1-4312-ad0d-c4f0d81a9834 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:03.055913 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-18fe55e9-75b1-4312-ad0d-c4f0d81a9834 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:03.056500 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-18fe55e9-75b1-4312-ad0d-c4f0d81a9834 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:03.438039 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-18fe55e9-75b1-4312-ad0d-c4f0d81a9834 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:03.466428 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-18fe55e9-75b1-4312-ad0d-c4f0d81a9834 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.420836 Apr 11 16:39:03.480642 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 191/394] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:03 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:04.268433 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-12d4d0d2-5a5a-4f4b-90aa-c37efef389c0 req-87555d29-e275-41b7-9282-5beba2a8ef22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b8c15a9-44fe-41af-affd-6ea36d214007", "tag": "851afbae-5cd1-4945-b6c6-66059ebc4234"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:39:04.278524 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-12d4d0d2-5a5a-4f4b-90aa-c37efef389c0 req-87555d29-e275-41b7-9282-5beba2a8ef22 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:04.279329 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-12d4d0d2-5a5a-4f4b-90aa-c37efef389c0 req-87555d29-e275-41b7-9282-5beba2a8ef22 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:04.295260 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-12d4d0d2-5a5a-4f4b-90aa-c37efef389c0 req-87555d29-e275-41b7-9282-5beba2a8ef22 service nova] Creating event network-changed:851afbae-5cd1-4945-b6c6-66059ebc4234 for instance 2b8c15a9-44fe-41af-affd-6ea36d214007 on hv-cinder-83716 Apr 11 16:39:04.302461 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-12d4d0d2-5a5a-4f4b-90aa-c37efef389c0 req-87555d29-e275-41b7-9282-5beba2a8ef22 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041694 Apr 11 16:39:04.307562 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 204/395] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:39:04.504816 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-072feaff-d566-445e-b7ba-e92cc8f0a1a1 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:04.509055 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-072feaff-d566-445e-b7ba-e92cc8f0a1a1 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:04.535843 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-072feaff-d566-445e-b7ba-e92cc8f0a1a1 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:04.538913 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-072feaff-d566-445e-b7ba-e92cc8f0a1a1 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:04.540772 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-072feaff-d566-445e-b7ba-e92cc8f0a1a1 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:04.546932 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-072feaff-d566-445e-b7ba-e92cc8f0a1a1 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:04.959275 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-072feaff-d566-445e-b7ba-e92cc8f0a1a1 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:04.975905 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-072feaff-d566-445e-b7ba-e92cc8f0a1a1 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.479898 Apr 11 16:39:04.977012 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 192/396] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:04 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:39:06.008166 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-918b5ffd-019e-494a-b180-b1deeef776c6 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:06.009354 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-918b5ffd-019e-494a-b180-b1deeef776c6 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:06.029166 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-918b5ffd-019e-494a-b180-b1deeef776c6 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:06.030168 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-918b5ffd-019e-494a-b180-b1deeef776c6 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:06.031685 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-918b5ffd-019e-494a-b180-b1deeef776c6 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:06.032573 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-918b5ffd-019e-494a-b180-b1deeef776c6 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:06.244041 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-918b5ffd-019e-494a-b180-b1deeef776c6 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:06.261850 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-918b5ffd-019e-494a-b180-b1deeef776c6 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.262277 Apr 11 16:39:06.274870 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 205/397] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:05 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:06.707691 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f779fb2b-b82a-4da5-bea5-8af146c7923c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Action: 'create', calling method: .version_select at 0x7f74181deb80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1775347678"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:39:06.732888 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-f779fb2b-b82a-4da5-bea5-8af146c7923c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Getting quotas for project f673779bead84d3c9d6d57eb3c65d5eb. Resources: {'key_pairs'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:39:06.743366 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-f779fb2b-b82a-4da5-bea5-8af146c7923c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Getting quotas for user b98e0a3c18be4651bb091e7f0c1c387e and project f673779bead84d3c9d6d57eb3c65d5eb. Resources: {'key_pairs'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:39:06.864592 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-f779fb2b-b82a-4da5-bea5-8af146c7923c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Getting quotas for project f673779bead84d3c9d6d57eb3c65d5eb. Resources: {'key_pairs'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:39:06.868544 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-f779fb2b-b82a-4da5-bea5-8af146c7923c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Getting quotas for user b98e0a3c18be4651bb091e7f0c1c387e and project f673779bead84d3c9d6d57eb3c65d5eb. Resources: {'key_pairs'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:39:06.882014 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f779fb2b-b82a-4da5-bea5-8af146c7923c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.178259 Apr 11 16:39:06.882620 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 193/398] 10.222.0.65 () {60 vars in 1157 bytes} [Mon Apr 11 16:39:06 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:06.994010 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-754d05af-20f7-499f-a3ef-98e7b80b7656 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1869288218", "imageRef": "223f2dff-5278-4d13-8fa5-094d797bcee9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1775347678", "networks": [{"uuid": "4478dee5-b317-4769-a31c-e852dd3d8a1a"}]}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:39:07.056203 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.network.neutron [None req-754d05af-20f7-499f-a3ef-98e7b80b7656 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] validate_networks() for [('4478dee5-b317-4769-a31c-e852dd3d8a1a', None, None, None, None, None)] {{(pid=123773) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:39:07.284094 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-1f19b888-a963-4d14-8284-c0b6e95280c2 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:07.284999 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-1f19b888-a963-4d14-8284-c0b6e95280c2 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:07.292623 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1f19b888-a963-4d14-8284-c0b6e95280c2 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:07.293071 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1f19b888-a963-4d14-8284-c0b6e95280c2 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:07.293868 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1f19b888-a963-4d14-8284-c0b6e95280c2 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:07.294304 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1f19b888-a963-4d14-8284-c0b6e95280c2 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:07.537833 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-1f19b888-a963-4d14-8284-c0b6e95280c2 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:07.553791 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-1f19b888-a963-4d14-8284-c0b6e95280c2 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.274384 Apr 11 16:39:07.554777 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 194/399] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:07 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:39:07.566181 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-754d05af-20f7-499f-a3ef-98e7b80b7656 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Flavor limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:39:07.566598 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-754d05af-20f7-499f-a3ef-98e7b80b7656 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Image limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:39:07.567067 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-754d05af-20f7-499f-a3ef-98e7b80b7656 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Flavor pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:39:07.567473 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-754d05af-20f7-499f-a3ef-98e7b80b7656 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Image pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:39:07.567924 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-754d05af-20f7-499f-a3ef-98e7b80b7656 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:39:07.579664 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-754d05af-20f7-499f-a3ef-98e7b80b7656 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:07.580115 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-754d05af-20f7-499f-a3ef-98e7b80b7656 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:07.580908 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-754d05af-20f7-499f-a3ef-98e7b80b7656 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:07.581342 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-754d05af-20f7-499f-a3ef-98e7b80b7656 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:07.599174 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-754d05af-20f7-499f-a3ef-98e7b80b7656 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Getting quotas for project f673779bead84d3c9d6d57eb3c65d5eb. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:39:07.603348 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-754d05af-20f7-499f-a3ef-98e7b80b7656 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Getting quotas for user b98e0a3c18be4651bb091e7f0c1c387e and project f673779bead84d3c9d6d57eb3c65d5eb. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:39:07.615875 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-754d05af-20f7-499f-a3ef-98e7b80b7656 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Going to run 1 instances... {{(pid=123773) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:39:07.618126 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-754d05af-20f7-499f-a3ef-98e7b80b7656 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='223f2dff-5278-4d13-8fa5-094d797bcee9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:39:07.670425 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-754d05af-20f7-499f-a3ef-98e7b80b7656 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680417 Apr 11 16:39:07.671647 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 206/400] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Apr 11 16:39:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 16:39:07.686913 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5fa8c64d-7c04-4376-876e-b68c61a4a617 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:07.687978 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5fa8c64d-7c04-4376-876e-b68c61a4a617 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:07.746058 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5fa8c64d-7c04-4376-876e-b68c61a4a617 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:07.754786 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5fa8c64d-7c04-4376-876e-b68c61a4a617 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1259 microversion: 2.1 time: 0.073566 Apr 11 16:39:07.757237 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 195/401] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:07 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1259 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:08.576688 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ea019bb0-4605-474e-9978-28753f0d751d tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:08.577376 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ea019bb0-4605-474e-9978-28753f0d751d tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:08.584552 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ea019bb0-4605-474e-9978-28753f0d751d tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:08.584989 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ea019bb0-4605-474e-9978-28753f0d751d tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:08.585758 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ea019bb0-4605-474e-9978-28753f0d751d tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:08.586177 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ea019bb0-4605-474e-9978-28753f0d751d tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:08.729222 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ea019bb0-4605-474e-9978-28753f0d751d tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:08.736967 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ea019bb0-4605-474e-9978-28753f0d751d tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.164289 Apr 11 16:39:08.737530 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 207/402] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:08 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:08.778091 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d2826b84-ee46-4e12-9ed5-bcc366c08260 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:08.778662 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d2826b84-ee46-4e12-9ed5-bcc366c08260 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:08.786620 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d2826b84-ee46-4e12-9ed5-bcc366c08260 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:08.787067 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d2826b84-ee46-4e12-9ed5-bcc366c08260 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:08.787890 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d2826b84-ee46-4e12-9ed5-bcc366c08260 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:08.788304 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d2826b84-ee46-4e12-9ed5-bcc366c08260 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:08.853412 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d2826b84-ee46-4e12-9ed5-bcc366c08260 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:08.861946 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d2826b84-ee46-4e12-9ed5-bcc366c08260 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1311 microversion: 2.1 time: 0.087772 Apr 11 16:39:08.862578 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 196/403] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:08 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1311 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:09.755008 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-a67ee0ec-69c9-482d-ab9d-c2657d5cb25c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:09.755713 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-a67ee0ec-69c9-482d-ab9d-c2657d5cb25c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:09.762162 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a67ee0ec-69c9-482d-ab9d-c2657d5cb25c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:09.762605 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a67ee0ec-69c9-482d-ab9d-c2657d5cb25c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:09.763365 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a67ee0ec-69c9-482d-ab9d-c2657d5cb25c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:09.763814 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a67ee0ec-69c9-482d-ab9d-c2657d5cb25c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:09.880716 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c315f549-2106-4037-b466-6cd0e2020585 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:09.881551 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c315f549-2106-4037-b466-6cd0e2020585 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:09.887973 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c315f549-2106-4037-b466-6cd0e2020585 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:09.888436 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c315f549-2106-4037-b466-6cd0e2020585 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:09.889177 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c315f549-2106-4037-b466-6cd0e2020585 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:09.889595 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c315f549-2106-4037-b466-6cd0e2020585 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:09.908891 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-a67ee0ec-69c9-482d-ab9d-c2657d5cb25c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:09.916193 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-a67ee0ec-69c9-482d-ab9d-c2657d5cb25c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.165541 Apr 11 16:39:09.916775 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 208/404] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:09 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:09.957161 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c315f549-2106-4037-b466-6cd0e2020585 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:09.965314 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c315f549-2106-4037-b466-6cd0e2020585 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1311 microversion: 2.1 time: 0.088549 Apr 11 16:39:09.965906 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 197/405] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:09 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1311 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:39:10.946053 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-479e82b1-773c-43c3-ac97-3246f81d7a21 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:10.947013 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-479e82b1-773c-43c3-ac97-3246f81d7a21 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:10.962930 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-479e82b1-773c-43c3-ac97-3246f81d7a21 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:10.963708 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-479e82b1-773c-43c3-ac97-3246f81d7a21 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:10.965294 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-479e82b1-773c-43c3-ac97-3246f81d7a21 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:10.966038 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-479e82b1-773c-43c3-ac97-3246f81d7a21 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:10.983363 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-1ea680e4-8843-4414-847c-12cd8a52ba6b tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:10.985043 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-1ea680e4-8843-4414-847c-12cd8a52ba6b tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:10.993616 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1ea680e4-8843-4414-847c-12cd8a52ba6b tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:10.994050 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1ea680e4-8843-4414-847c-12cd8a52ba6b tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:10.996497 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1ea680e4-8843-4414-847c-12cd8a52ba6b tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:10.997137 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1ea680e4-8843-4414-847c-12cd8a52ba6b tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:11.264111 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-479e82b1-773c-43c3-ac97-3246f81d7a21 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:11.289110 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-479e82b1-773c-43c3-ac97-3246f81d7a21 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.357818 Apr 11 16:39:11.290371 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 209/406] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:10 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:11.435058 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-1ea680e4-8843-4414-847c-12cd8a52ba6b tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:11.449098 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-1ea680e4-8843-4414-847c-12cd8a52ba6b tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.470394 Apr 11 16:39:11.460264 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 198/407] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:10 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:39:12.309775 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-a28595b0-794b-4f80-b82c-bb6d1ab01e15 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:12.310662 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-a28595b0-794b-4f80-b82c-bb6d1ab01e15 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:12.318876 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a28595b0-794b-4f80-b82c-bb6d1ab01e15 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:12.319311 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a28595b0-794b-4f80-b82c-bb6d1ab01e15 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:12.320143 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a28595b0-794b-4f80-b82c-bb6d1ab01e15 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:12.320573 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a28595b0-794b-4f80-b82c-bb6d1ab01e15 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:12.479780 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-3e75b6f5-7cb1-4f66-89ed-30faa372df79 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:12.482909 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-3e75b6f5-7cb1-4f66-89ed-30faa372df79 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:12.490509 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3e75b6f5-7cb1-4f66-89ed-30faa372df79 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:12.491301 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3e75b6f5-7cb1-4f66-89ed-30faa372df79 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:12.492326 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3e75b6f5-7cb1-4f66-89ed-30faa372df79 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:12.492820 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3e75b6f5-7cb1-4f66-89ed-30faa372df79 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:12.507142 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-a28595b0-794b-4f80-b82c-bb6d1ab01e15 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:12.521796 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-a28595b0-794b-4f80-b82c-bb6d1ab01e15 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.218883 Apr 11 16:39:12.522734 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 210/408] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:12 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:12.674154 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-3e75b6f5-7cb1-4f66-89ed-30faa372df79 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:12.682666 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-3e75b6f5-7cb1-4f66-89ed-30faa372df79 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.207178 Apr 11 16:39:12.683322 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 199/409] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:12 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:13.353053 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-e573c6aa-b29f-4eb0-80f1-46f341e8a581 req-dab27943-fe95-4284-9e8b-682d3fceffa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cccd6eb0-741e-48d1-9539-108d80ff2cad", "name": "network-vif-plugged", "status": "completed", "tag": "a6f4f255-f8e2-4c79-9875-d58fd39df6bf"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:39:13.364976 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-e573c6aa-b29f-4eb0-80f1-46f341e8a581 req-dab27943-fe95-4284-9e8b-682d3fceffa0 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:13.365897 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-e573c6aa-b29f-4eb0-80f1-46f341e8a581 req-dab27943-fe95-4284-9e8b-682d3fceffa0 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:13.381826 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-e573c6aa-b29f-4eb0-80f1-46f341e8a581 req-dab27943-fe95-4284-9e8b-682d3fceffa0 service nova] Creating event network-vif-plugged:a6f4f255-f8e2-4c79-9875-d58fd39df6bf for instance cccd6eb0-741e-48d1-9539-108d80ff2cad on hv-cinder-83716 Apr 11 16:39:13.392186 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-e573c6aa-b29f-4eb0-80f1-46f341e8a581 req-dab27943-fe95-4284-9e8b-682d3fceffa0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042392 Apr 11 16:39:13.393228 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 211/410] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:39:13.544849 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-28813f25-0864-44d6-b4b8-5da09839a6ad tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:13.547371 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-28813f25-0864-44d6-b4b8-5da09839a6ad tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:13.559359 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-28813f25-0864-44d6-b4b8-5da09839a6ad tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:13.560636 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-28813f25-0864-44d6-b4b8-5da09839a6ad tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:13.562640 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-28813f25-0864-44d6-b4b8-5da09839a6ad tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:13.563967 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-28813f25-0864-44d6-b4b8-5da09839a6ad tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:13.700931 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-0ed0716c-52d2-4a4f-8aca-0adc52d28c2d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:13.701720 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-0ed0716c-52d2-4a4f-8aca-0adc52d28c2d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:13.708573 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0ed0716c-52d2-4a4f-8aca-0adc52d28c2d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:13.709102 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0ed0716c-52d2-4a4f-8aca-0adc52d28c2d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:13.709979 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0ed0716c-52d2-4a4f-8aca-0adc52d28c2d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:13.710510 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0ed0716c-52d2-4a4f-8aca-0adc52d28c2d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:13.740768 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-28813f25-0864-44d6-b4b8-5da09839a6ad tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:13.750479 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-28813f25-0864-44d6-b4b8-5da09839a6ad tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.213218 Apr 11 16:39:13.751446 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 200/411] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:13 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:13.855967 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-0ed0716c-52d2-4a4f-8aca-0adc52d28c2d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:13.864705 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-0ed0716c-52d2-4a4f-8aca-0adc52d28c2d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.168041 Apr 11 16:39:13.865331 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 212/412] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:13 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:39:14.768506 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e56081bc-44fd-453a-8c39-054b89a3291b tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:14.769231 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e56081bc-44fd-453a-8c39-054b89a3291b tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:14.776376 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e56081bc-44fd-453a-8c39-054b89a3291b tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:14.776854 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e56081bc-44fd-453a-8c39-054b89a3291b tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:14.777645 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e56081bc-44fd-453a-8c39-054b89a3291b tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:14.778102 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e56081bc-44fd-453a-8c39-054b89a3291b tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:14.889255 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1f9449a2-9377-475c-a0b5-5aac9fc7482d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:14.890686 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1f9449a2-9377-475c-a0b5-5aac9fc7482d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:14.898821 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1f9449a2-9377-475c-a0b5-5aac9fc7482d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:14.899421 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1f9449a2-9377-475c-a0b5-5aac9fc7482d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:14.900260 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1f9449a2-9377-475c-a0b5-5aac9fc7482d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:14.901411 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1f9449a2-9377-475c-a0b5-5aac9fc7482d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:15.102273 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e56081bc-44fd-453a-8c39-054b89a3291b tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:15.110698 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e56081bc-44fd-453a-8c39-054b89a3291b tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.345953 Apr 11 16:39:15.111312 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 201/413] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:14 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:15.156689 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1f9449a2-9377-475c-a0b5-5aac9fc7482d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:15.164840 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1f9449a2-9377-475c-a0b5-5aac9fc7482d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.285010 Apr 11 16:39:15.165424 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 213/414] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:14 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:16.132319 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c5eb7e0b-c220-4e3d-ae0d-84824aa147c5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:16.134470 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c5eb7e0b-c220-4e3d-ae0d-84824aa147c5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:16.143549 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c5eb7e0b-c220-4e3d-ae0d-84824aa147c5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:16.144120 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c5eb7e0b-c220-4e3d-ae0d-84824aa147c5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:16.145002 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c5eb7e0b-c220-4e3d-ae0d-84824aa147c5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:16.145502 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c5eb7e0b-c220-4e3d-ae0d-84824aa147c5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:16.183861 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-0924f0bc-fc26-41a7-80d8-b66575a104c1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:16.184496 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-0924f0bc-fc26-41a7-80d8-b66575a104c1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:16.191170 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0924f0bc-fc26-41a7-80d8-b66575a104c1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:16.191608 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0924f0bc-fc26-41a7-80d8-b66575a104c1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:16.192410 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0924f0bc-fc26-41a7-80d8-b66575a104c1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:16.192832 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0924f0bc-fc26-41a7-80d8-b66575a104c1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:16.338325 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c5eb7e0b-c220-4e3d-ae0d-84824aa147c5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:16.347318 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c5eb7e0b-c220-4e3d-ae0d-84824aa147c5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.223532 Apr 11 16:39:16.348082 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 202/415] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:16 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:39:16.370376 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-0924f0bc-fc26-41a7-80d8-b66575a104c1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:16.378858 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-0924f0bc-fc26-41a7-80d8-b66575a104c1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.199011 Apr 11 16:39:16.379471 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 214/416] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:16 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:39:17.365964 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f5608bf8-26d4-433b-bbfc-148b19344f3c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:17.366825 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f5608bf8-26d4-433b-bbfc-148b19344f3c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:17.374190 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f5608bf8-26d4-433b-bbfc-148b19344f3c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:17.374921 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f5608bf8-26d4-433b-bbfc-148b19344f3c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:17.376234 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f5608bf8-26d4-433b-bbfc-148b19344f3c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:17.376785 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f5608bf8-26d4-433b-bbfc-148b19344f3c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:17.398527 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c6458171-6c4f-4ac6-9ffa-8649149744e4 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:17.399366 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c6458171-6c4f-4ac6-9ffa-8649149744e4 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:17.406851 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c6458171-6c4f-4ac6-9ffa-8649149744e4 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:17.407718 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c6458171-6c4f-4ac6-9ffa-8649149744e4 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:17.416463 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c6458171-6c4f-4ac6-9ffa-8649149744e4 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:17.417734 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c6458171-6c4f-4ac6-9ffa-8649149744e4 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:17.883051 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f5608bf8-26d4-433b-bbfc-148b19344f3c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:17.890899 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c6458171-6c4f-4ac6-9ffa-8649149744e4 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:17.891167 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f5608bf8-26d4-433b-bbfc-148b19344f3c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.529500 Apr 11 16:39:17.891555 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 203/417] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:17 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:17.906319 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c6458171-6c4f-4ac6-9ffa-8649149744e4 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.512452 Apr 11 16:39:17.908338 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 215/418] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:17 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:18.914716 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a2e18101-f01c-4d55-b957-2c9f581a0f29 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:18.915491 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a2e18101-f01c-4d55-b957-2c9f581a0f29 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:18.922914 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a2e18101-f01c-4d55-b957-2c9f581a0f29 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:18.923341 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a2e18101-f01c-4d55-b957-2c9f581a0f29 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:18.924213 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a2e18101-f01c-4d55-b957-2c9f581a0f29 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:18.924650 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a2e18101-f01c-4d55-b957-2c9f581a0f29 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:18.931016 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3e65393a-71cf-4f24-969e-b3d4a12a1a93 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:18.931605 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3e65393a-71cf-4f24-969e-b3d4a12a1a93 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:18.938629 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3e65393a-71cf-4f24-969e-b3d4a12a1a93 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:18.939163 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3e65393a-71cf-4f24-969e-b3d4a12a1a93 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:18.940034 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3e65393a-71cf-4f24-969e-b3d4a12a1a93 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:18.940576 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3e65393a-71cf-4f24-969e-b3d4a12a1a93 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:19.154582 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3e65393a-71cf-4f24-969e-b3d4a12a1a93 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:19.165028 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a2e18101-f01c-4d55-b957-2c9f581a0f29 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:19.167303 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3e65393a-71cf-4f24-969e-b3d4a12a1a93 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.239779 Apr 11 16:39:19.168351 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 216/419] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:18 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:19.176441 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a2e18101-f01c-4d55-b957-2c9f581a0f29 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.265457 Apr 11 16:39:19.177360 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 204/420] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:18 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:20.185723 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ea343b07-4541-4a09-b17c-b991a67191e1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:20.186461 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ea343b07-4541-4a09-b17c-b991a67191e1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:20.193617 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-137799bd-6553-412d-a79b-0a31862e28d5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:20.194216 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ea343b07-4541-4a09-b17c-b991a67191e1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:20.194216 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ea343b07-4541-4a09-b17c-b991a67191e1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:20.194413 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-137799bd-6553-412d-a79b-0a31862e28d5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:20.195259 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ea343b07-4541-4a09-b17c-b991a67191e1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:20.195856 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ea343b07-4541-4a09-b17c-b991a67191e1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:20.200843 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-137799bd-6553-412d-a79b-0a31862e28d5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:20.201609 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-137799bd-6553-412d-a79b-0a31862e28d5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:20.202226 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-137799bd-6553-412d-a79b-0a31862e28d5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:20.202763 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-137799bd-6553-412d-a79b-0a31862e28d5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:20.415298 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ea343b07-4541-4a09-b17c-b991a67191e1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:20.417475 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-137799bd-6553-412d-a79b-0a31862e28d5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:20.425723 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-137799bd-6553-412d-a79b-0a31862e28d5 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.235885 Apr 11 16:39:20.436265 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 205/421] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:20 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:20.440438 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ea343b07-4541-4a09-b17c-b991a67191e1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.257942 Apr 11 16:39:20.442121 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 217/422] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:20 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:21.442710 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-79d9ed0f-79ec-48c6-8f37-d1b46d58a015 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:21.443303 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-79d9ed0f-79ec-48c6-8f37-d1b46d58a015 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:21.449848 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-79d9ed0f-79ec-48c6-8f37-d1b46d58a015 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:21.450291 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-79d9ed0f-79ec-48c6-8f37-d1b46d58a015 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:21.451064 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-79d9ed0f-79ec-48c6-8f37-d1b46d58a015 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:21.451490 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-79d9ed0f-79ec-48c6-8f37-d1b46d58a015 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:21.458515 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-7c64a457-b19f-4150-a45d-21d4c61dce8d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:21.460053 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-7c64a457-b19f-4150-a45d-21d4c61dce8d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:21.466955 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7c64a457-b19f-4150-a45d-21d4c61dce8d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:21.467576 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7c64a457-b19f-4150-a45d-21d4c61dce8d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:21.468598 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7c64a457-b19f-4150-a45d-21d4c61dce8d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:21.469113 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7c64a457-b19f-4150-a45d-21d4c61dce8d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:21.655913 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-79d9ed0f-79ec-48c6-8f37-d1b46d58a015 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:21.664051 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-79d9ed0f-79ec-48c6-8f37-d1b46d58a015 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.225189 Apr 11 16:39:21.664639 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 206/423] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:21 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:21.668364 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-7c64a457-b19f-4150-a45d-21d4c61dce8d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:21.676912 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-7c64a457-b19f-4150-a45d-21d4c61dce8d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.222143 Apr 11 16:39:21.677525 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 218/424] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:21 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:39:22.680913 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f94465d7-8697-4cd9-b9dc-e026bb7e9a56 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:22.681531 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f94465d7-8697-4cd9-b9dc-e026bb7e9a56 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:22.688451 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f94465d7-8697-4cd9-b9dc-e026bb7e9a56 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:22.688896 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f94465d7-8697-4cd9-b9dc-e026bb7e9a56 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:22.689704 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f94465d7-8697-4cd9-b9dc-e026bb7e9a56 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:22.690133 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f94465d7-8697-4cd9-b9dc-e026bb7e9a56 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:22.694272 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-dbb85d84-6c87-44d5-beae-03a2e40c2de1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:22.694886 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-dbb85d84-6c87-44d5-beae-03a2e40c2de1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:22.700920 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dbb85d84-6c87-44d5-beae-03a2e40c2de1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:22.701368 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dbb85d84-6c87-44d5-beae-03a2e40c2de1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:22.702236 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dbb85d84-6c87-44d5-beae-03a2e40c2de1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:22.702677 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dbb85d84-6c87-44d5-beae-03a2e40c2de1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:22.929912 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f94465d7-8697-4cd9-b9dc-e026bb7e9a56 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:22.933708 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-dbb85d84-6c87-44d5-beae-03a2e40c2de1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:22.938404 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f94465d7-8697-4cd9-b9dc-e026bb7e9a56 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.261449 Apr 11 16:39:22.939012 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 207/425] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:22 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:22.941794 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-dbb85d84-6c87-44d5-beae-03a2e40c2de1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.251294 Apr 11 16:39:22.942418 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 219/426] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:22 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:23.957051 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-6f6c8c85-d91f-4624-8b6f-982c910d767c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:23.958592 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-6f6c8c85-d91f-4624-8b6f-982c910d767c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:23.967919 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6f6c8c85-d91f-4624-8b6f-982c910d767c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:23.968813 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-9994d417-a2e0-40ed-9be9-139b9451e483 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:23.969583 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6f6c8c85-d91f-4624-8b6f-982c910d767c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:23.970938 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6f6c8c85-d91f-4624-8b6f-982c910d767c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:23.972452 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6f6c8c85-d91f-4624-8b6f-982c910d767c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:23.972725 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-9994d417-a2e0-40ed-9be9-139b9451e483 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:23.988661 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9994d417-a2e0-40ed-9be9-139b9451e483 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:23.989470 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9994d417-a2e0-40ed-9be9-139b9451e483 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:23.990635 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9994d417-a2e0-40ed-9be9-139b9451e483 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:23.991215 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9994d417-a2e0-40ed-9be9-139b9451e483 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:24.189979 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-6f6c8c85-d91f-4624-8b6f-982c910d767c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:24.193079 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9994d417-a2e0-40ed-9be9-139b9451e483 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:24.198008 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-6f6c8c85-d91f-4624-8b6f-982c910d767c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.245776 Apr 11 16:39:24.198755 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 208/427] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:23 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:24.200803 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-9994d417-a2e0-40ed-9be9-139b9451e483 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.246212 Apr 11 16:39:24.201367 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 220/428] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:23 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:25.215168 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-fa5c84c0-a788-4f0a-a391-58ddc774a09d tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:25.216539 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-fa5c84c0-a788-4f0a-a391-58ddc774a09d tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:25.219005 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-93eb41d1-3c03-4c89-a536-a883995dee89 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:25.220627 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-93eb41d1-3c03-4c89-a536-a883995dee89 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:25.227594 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-93eb41d1-3c03-4c89-a536-a883995dee89 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:25.228219 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-93eb41d1-3c03-4c89-a536-a883995dee89 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:25.229447 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-93eb41d1-3c03-4c89-a536-a883995dee89 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:25.229780 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fa5c84c0-a788-4f0a-a391-58ddc774a09d tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:25.229902 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-93eb41d1-3c03-4c89-a536-a883995dee89 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:25.230531 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fa5c84c0-a788-4f0a-a391-58ddc774a09d tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:25.231511 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fa5c84c0-a788-4f0a-a391-58ddc774a09d tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:25.232159 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fa5c84c0-a788-4f0a-a391-58ddc774a09d tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:25.441265 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-93eb41d1-3c03-4c89-a536-a883995dee89 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:25.444983 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-93eb41d1-3c03-4c89-a536-a883995dee89 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.230700 Apr 11 16:39:25.445928 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 221/429] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:25 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:25.446459 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-fa5c84c0-a788-4f0a-a391-58ddc774a09d tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:25.457333 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-fa5c84c0-a788-4f0a-a391-58ddc774a09d tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.246539 Apr 11 16:39:25.458343 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 209/430] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:25 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:26.464911 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-9a8a5f46-434a-40ca-b595-b64268cff151 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:26.466469 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-9a8a5f46-434a-40ca-b595-b64268cff151 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:26.473033 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9a8a5f46-434a-40ca-b595-b64268cff151 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:26.473490 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9a8a5f46-434a-40ca-b595-b64268cff151 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:26.474276 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9a8a5f46-434a-40ca-b595-b64268cff151 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:26.474704 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9a8a5f46-434a-40ca-b595-b64268cff151 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:26.478411 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-29d54314-8334-4cff-b57d-2c23ea23f308 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:26.479546 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-29d54314-8334-4cff-b57d-2c23ea23f308 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:26.485957 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-29d54314-8334-4cff-b57d-2c23ea23f308 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:26.486396 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-29d54314-8334-4cff-b57d-2c23ea23f308 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:26.487162 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-29d54314-8334-4cff-b57d-2c23ea23f308 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:26.487588 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-29d54314-8334-4cff-b57d-2c23ea23f308 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:26.678771 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9a8a5f46-434a-40ca-b595-b64268cff151 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:26.681957 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-29d54314-8334-4cff-b57d-2c23ea23f308 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:26.687761 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-9a8a5f46-434a-40ca-b595-b64268cff151 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.226728 Apr 11 16:39:26.688309 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 222/431] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:26 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:26.690443 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-29d54314-8334-4cff-b57d-2c23ea23f308 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.215980 Apr 11 16:39:26.691113 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 210/432] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:26 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:27.705104 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-faa879e3-1be5-44c3-8eb2-b17aec82ccd2 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:27.705714 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-faa879e3-1be5-44c3-8eb2-b17aec82ccd2 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:27.708542 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a9bce1e4-1a8e-4b69-9e2a-8ca25b10bbc3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:27.709232 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a9bce1e4-1a8e-4b69-9e2a-8ca25b10bbc3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:27.712976 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-faa879e3-1be5-44c3-8eb2-b17aec82ccd2 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:27.713426 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-faa879e3-1be5-44c3-8eb2-b17aec82ccd2 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:27.714216 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-faa879e3-1be5-44c3-8eb2-b17aec82ccd2 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:27.714645 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-faa879e3-1be5-44c3-8eb2-b17aec82ccd2 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:27.715895 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a9bce1e4-1a8e-4b69-9e2a-8ca25b10bbc3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:27.716336 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a9bce1e4-1a8e-4b69-9e2a-8ca25b10bbc3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:27.717442 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a9bce1e4-1a8e-4b69-9e2a-8ca25b10bbc3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:27.717654 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a9bce1e4-1a8e-4b69-9e2a-8ca25b10bbc3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:27.908352 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-faa879e3-1be5-44c3-8eb2-b17aec82ccd2 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:27.912051 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a9bce1e4-1a8e-4b69-9e2a-8ca25b10bbc3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:27.916038 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-faa879e3-1be5-44c3-8eb2-b17aec82ccd2 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.214755 Apr 11 16:39:27.916653 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 223/433] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:27 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:27.920044 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a9bce1e4-1a8e-4b69-9e2a-8ca25b10bbc3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.215144 Apr 11 16:39:27.920771 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 211/434] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:27 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:28.933677 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-62c33866-9aa0-4ed0-9762-212e43a80baa tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:28.934385 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-62c33866-9aa0-4ed0-9762-212e43a80baa tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:28.937577 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c5e0ec98-e324-4356-831a-bd427e707649 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:28.938619 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c5e0ec98-e324-4356-831a-bd427e707649 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:28.941567 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-62c33866-9aa0-4ed0-9762-212e43a80baa tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:28.942047 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-62c33866-9aa0-4ed0-9762-212e43a80baa tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:28.942835 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-62c33866-9aa0-4ed0-9762-212e43a80baa tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:28.943283 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-62c33866-9aa0-4ed0-9762-212e43a80baa tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:28.945079 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c5e0ec98-e324-4356-831a-bd427e707649 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:28.945525 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c5e0ec98-e324-4356-831a-bd427e707649 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:28.946318 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c5e0ec98-e324-4356-831a-bd427e707649 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:28.946743 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c5e0ec98-e324-4356-831a-bd427e707649 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:29.158154 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-62c33866-9aa0-4ed0-9762-212e43a80baa tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:29.161930 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c5e0ec98-e324-4356-831a-bd427e707649 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:29.166057 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-62c33866-9aa0-4ed0-9762-212e43a80baa tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.236201 Apr 11 16:39:29.166601 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 224/435] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:28 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:29.169386 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c5e0ec98-e324-4356-831a-bd427e707649 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.236241 Apr 11 16:39:29.169981 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 212/436] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:28 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:30.184823 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-42aa73c6-ec59-49d2-b3ff-72d153b266bc tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:30.185419 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-73da5b22-c638-472f-bdbc-6f845ad83077 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:30.186280 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-73da5b22-c638-472f-bdbc-6f845ad83077 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:30.186861 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-42aa73c6-ec59-49d2-b3ff-72d153b266bc tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:30.193552 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-42aa73c6-ec59-49d2-b3ff-72d153b266bc tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:30.194264 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-42aa73c6-ec59-49d2-b3ff-72d153b266bc tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:30.194908 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-73da5b22-c638-472f-bdbc-6f845ad83077 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:30.195407 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-42aa73c6-ec59-49d2-b3ff-72d153b266bc tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:30.195530 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-73da5b22-c638-472f-bdbc-6f845ad83077 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:30.196265 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-42aa73c6-ec59-49d2-b3ff-72d153b266bc tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:30.196635 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-73da5b22-c638-472f-bdbc-6f845ad83077 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:30.197156 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-73da5b22-c638-472f-bdbc-6f845ad83077 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:30.501928 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-42aa73c6-ec59-49d2-b3ff-72d153b266bc tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:30.502286 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-73da5b22-c638-472f-bdbc-6f845ad83077 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:30.511177 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-73da5b22-c638-472f-bdbc-6f845ad83077 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.329675 Apr 11 16:39:30.511971 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 213/437] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:30 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:30.514087 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-42aa73c6-ec59-49d2-b3ff-72d153b266bc tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.334806 Apr 11 16:39:30.523874 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 225/438] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:30 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:30.566985 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-b54c2673-b7ae-40ea-ae61-41e36f7c45e7 req-7a5f1c16-b54c-497b-83ee-51f3c5942844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "494cad61-7e0d-49b6-aa92-6354407d825d", "tag": "900247d2-717f-4100-a8c4-2e6811bb9b9b"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:39:30.579459 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-b54c2673-b7ae-40ea-ae61-41e36f7c45e7 req-7a5f1c16-b54c-497b-83ee-51f3c5942844 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:30.580216 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-b54c2673-b7ae-40ea-ae61-41e36f7c45e7 req-7a5f1c16-b54c-497b-83ee-51f3c5942844 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:30.595082 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-b54c2673-b7ae-40ea-ae61-41e36f7c45e7 req-7a5f1c16-b54c-497b-83ee-51f3c5942844 service nova] Creating event network-changed:900247d2-717f-4100-a8c4-2e6811bb9b9b for instance 494cad61-7e0d-49b6-aa92-6354407d825d on hv-cinder-83716 Apr 11 16:39:30.600452 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-b54c2673-b7ae-40ea-ae61-41e36f7c45e7 req-7a5f1c16-b54c-497b-83ee-51f3c5942844 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038045 Apr 11 16:39:30.601061 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 214/439] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:39:31.528727 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-324aaff5-27be-4ced-aa52-004a5ccbebeb tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:31.529535 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-324aaff5-27be-4ced-aa52-004a5ccbebeb tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:31.530988 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f23c7224-d733-4177-899f-ca074a718750 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:31.532256 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f23c7224-d733-4177-899f-ca074a718750 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:31.537276 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-324aaff5-27be-4ced-aa52-004a5ccbebeb tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:31.537719 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-324aaff5-27be-4ced-aa52-004a5ccbebeb tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:31.538482 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-324aaff5-27be-4ced-aa52-004a5ccbebeb tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:31.539014 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-324aaff5-27be-4ced-aa52-004a5ccbebeb tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:31.541508 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f23c7224-d733-4177-899f-ca074a718750 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:31.542169 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f23c7224-d733-4177-899f-ca074a718750 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:31.542947 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f23c7224-d733-4177-899f-ca074a718750 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:31.544568 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f23c7224-d733-4177-899f-ca074a718750 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:31.770956 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f23c7224-d733-4177-899f-ca074a718750 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:31.778698 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f23c7224-d733-4177-899f-ca074a718750 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.252138 Apr 11 16:39:31.779343 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 215/440] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:31 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:31.779614 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-324aaff5-27be-4ced-aa52-004a5ccbebeb tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:31.787956 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-324aaff5-27be-4ced-aa52-004a5ccbebeb tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1261 microversion: 2.1 time: 0.262975 Apr 11 16:39:31.788817 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 226/441] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:31 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1261 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:32.796211 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ce848eb9-baa6-42a7-a5ea-86885f621240 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:32.796937 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ce848eb9-baa6-42a7-a5ea-86885f621240 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:32.803981 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ce848eb9-baa6-42a7-a5ea-86885f621240 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:32.804426 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ce848eb9-baa6-42a7-a5ea-86885f621240 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:32.805111 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c5b95198-e386-4dab-9cdc-26f59585c9d9 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:32.805589 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ce848eb9-baa6-42a7-a5ea-86885f621240 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:32.805589 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ce848eb9-baa6-42a7-a5ea-86885f621240 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:32.805780 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c5b95198-e386-4dab-9cdc-26f59585c9d9 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:32.813150 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c5b95198-e386-4dab-9cdc-26f59585c9d9 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:32.813989 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c5b95198-e386-4dab-9cdc-26f59585c9d9 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:32.814776 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c5b95198-e386-4dab-9cdc-26f59585c9d9 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:32.815208 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c5b95198-e386-4dab-9cdc-26f59585c9d9 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:33.095024 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c5b95198-e386-4dab-9cdc-26f59585c9d9 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:33.101894 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ce848eb9-baa6-42a7-a5ea-86885f621240 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:33.102528 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c5b95198-e386-4dab-9cdc-26f59585c9d9 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1446 microversion: 2.1 time: 0.301226 Apr 11 16:39:33.103462 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 227/442] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:32 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1446 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:33.119393 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b0aaeca5-133a-4f72-8446-22f82486add3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:33.120288 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b0aaeca5-133a-4f72-8446-22f82486add3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:33.122101 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ce848eb9-baa6-42a7-a5ea-86885f621240 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.329922 Apr 11 16:39:33.123052 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 216/443] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:32 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:33.127845 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b0aaeca5-133a-4f72-8446-22f82486add3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:33.128767 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b0aaeca5-133a-4f72-8446-22f82486add3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:33.129739 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b0aaeca5-133a-4f72-8446-22f82486add3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:33.130441 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b0aaeca5-133a-4f72-8446-22f82486add3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:33.281379 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b0aaeca5-133a-4f72-8446-22f82486add3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:33.289579 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b0aaeca5-133a-4f72-8446-22f82486add3 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1446 microversion: 2.1 time: 0.173965 Apr 11 16:39:33.290215 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 228/444] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:33 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1446 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:34.140365 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-4a99771f-1668-440f-acca-5ee6fa85e635 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:34.140985 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-4a99771f-1668-440f-acca-5ee6fa85e635 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:34.147402 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4a99771f-1668-440f-acca-5ee6fa85e635 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:34.147879 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4a99771f-1668-440f-acca-5ee6fa85e635 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:34.148665 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4a99771f-1668-440f-acca-5ee6fa85e635 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:34.149074 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4a99771f-1668-440f-acca-5ee6fa85e635 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:34.289635 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-4a99771f-1668-440f-acca-5ee6fa85e635 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:34.297342 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-4a99771f-1668-440f-acca-5ee6fa85e635 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.161303 Apr 11 16:39:34.297925 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 217/445] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:34 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:35.314720 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-4be66cac-6d64-45da-9279-d2ccc203021d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:35.315287 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-4be66cac-6d64-45da-9279-d2ccc203021d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:35.321504 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4be66cac-6d64-45da-9279-d2ccc203021d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:35.321949 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4be66cac-6d64-45da-9279-d2ccc203021d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:35.322713 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4be66cac-6d64-45da-9279-d2ccc203021d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:35.323133 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4be66cac-6d64-45da-9279-d2ccc203021d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:35.466819 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-4be66cac-6d64-45da-9279-d2ccc203021d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:35.475060 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-4be66cac-6d64-45da-9279-d2ccc203021d tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.164472 Apr 11 16:39:35.475607 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 229/446] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:35 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:35.566482 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-b07722c2-e063-416c-9e52-4a70e1ff2471 req-3c71070b-cb52-435a-bf13-0d1c1fc24707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cccd6eb0-741e-48d1-9539-108d80ff2cad", "tag": "a6f4f255-f8e2-4c79-9875-d58fd39df6bf"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:39:35.574896 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-b07722c2-e063-416c-9e52-4a70e1ff2471 req-3c71070b-cb52-435a-bf13-0d1c1fc24707 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:35.575335 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-b07722c2-e063-416c-9e52-4a70e1ff2471 req-3c71070b-cb52-435a-bf13-0d1c1fc24707 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:35.587443 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-b07722c2-e063-416c-9e52-4a70e1ff2471 req-3c71070b-cb52-435a-bf13-0d1c1fc24707 service nova] Creating event network-changed:a6f4f255-f8e2-4c79-9875-d58fd39df6bf for instance cccd6eb0-741e-48d1-9539-108d80ff2cad on hv-cinder-83716 Apr 11 16:39:35.593127 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-b07722c2-e063-416c-9e52-4a70e1ff2471 req-3c71070b-cb52-435a-bf13-0d1c1fc24707 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031059 Apr 11 16:39:35.593731 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 218/447] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:39:35.810932 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-282750d7-4f35-42d6-85ac-338e9c4ad876 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:35.811580 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-282750d7-4f35-42d6-85ac-338e9c4ad876 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:35.818629 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-282750d7-4f35-42d6-85ac-338e9c4ad876 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:35.818956 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-282750d7-4f35-42d6-85ac-338e9c4ad876 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:35.819757 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-282750d7-4f35-42d6-85ac-338e9c4ad876 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:35.820186 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-282750d7-4f35-42d6-85ac-338e9c4ad876 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:35.853704 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-282750d7-4f35-42d6-85ac-338e9c4ad876 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a/ips" status: 200 len: 151 microversion: 2.20 time: 0.046707 Apr 11 16:39:35.854286 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 230/448] 10.222.0.65 () {60 vars in 1288 bytes} [Mon Apr 11 16:39:35 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:39:36.493026 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-69c2563b-03ab-4ef0-ad2d-4c96e3d5c9be tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:36.494512 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-69c2563b-03ab-4ef0-ad2d-4c96e3d5c9be tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:36.500813 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-69c2563b-03ab-4ef0-ad2d-4c96e3d5c9be tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:36.501610 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-69c2563b-03ab-4ef0-ad2d-4c96e3d5c9be tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:36.502035 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-69c2563b-03ab-4ef0-ad2d-4c96e3d5c9be tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:36.502496 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-69c2563b-03ab-4ef0-ad2d-4c96e3d5c9be tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:36.671077 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-69c2563b-03ab-4ef0-ad2d-4c96e3d5c9be tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:36.679454 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-69c2563b-03ab-4ef0-ad2d-4c96e3d5c9be tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.190717 Apr 11 16:39:36.680430 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 219/449] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:36 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:37.700555 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-fc775a0d-8dc0-4c11-9594-e2c0c5e6c53f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:37.701523 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-fc775a0d-8dc0-4c11-9594-e2c0c5e6c53f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:37.708265 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fc775a0d-8dc0-4c11-9594-e2c0c5e6c53f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:37.708681 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fc775a0d-8dc0-4c11-9594-e2c0c5e6c53f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:37.709516 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fc775a0d-8dc0-4c11-9594-e2c0c5e6c53f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:37.709966 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fc775a0d-8dc0-4c11-9594-e2c0c5e6c53f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:37.847584 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-fc775a0d-8dc0-4c11-9594-e2c0c5e6c53f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:37.855475 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-fc775a0d-8dc0-4c11-9594-e2c0c5e6c53f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.158738 Apr 11 16:39:37.856095 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 231/450] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:37 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:38.873491 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-434486d7-c7cc-4fb5-a948-a53d3c83be83 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:38.874316 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-434486d7-c7cc-4fb5-a948-a53d3c83be83 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:38.881434 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-434486d7-c7cc-4fb5-a948-a53d3c83be83 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:38.881903 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-434486d7-c7cc-4fb5-a948-a53d3c83be83 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:38.882710 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-434486d7-c7cc-4fb5-a948-a53d3c83be83 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:38.883199 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-434486d7-c7cc-4fb5-a948-a53d3c83be83 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:39.025761 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-434486d7-c7cc-4fb5-a948-a53d3c83be83 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:39.035181 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-434486d7-c7cc-4fb5-a948-a53d3c83be83 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.165723 Apr 11 16:39:39.035879 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 220/451] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:38 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:40.053051 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-7f9812e3-dbb7-431b-aac9-894fe52f2113 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:40.053700 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-7f9812e3-dbb7-431b-aac9-894fe52f2113 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:40.060478 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7f9812e3-dbb7-431b-aac9-894fe52f2113 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:40.061100 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7f9812e3-dbb7-431b-aac9-894fe52f2113 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:40.062014 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7f9812e3-dbb7-431b-aac9-894fe52f2113 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:40.062524 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7f9812e3-dbb7-431b-aac9-894fe52f2113 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:40.209789 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-7f9812e3-dbb7-431b-aac9-894fe52f2113 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:40.222444 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-7f9812e3-dbb7-431b-aac9-894fe52f2113 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.172842 Apr 11 16:39:40.224024 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 232/452] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:40 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:41.242034 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-59a5eb26-07c2-4b78-b0e2-4a8c7fc611f3 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:41.242756 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-59a5eb26-07c2-4b78-b0e2-4a8c7fc611f3 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:41.250567 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-59a5eb26-07c2-4b78-b0e2-4a8c7fc611f3 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:41.251006 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-59a5eb26-07c2-4b78-b0e2-4a8c7fc611f3 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:41.251849 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-59a5eb26-07c2-4b78-b0e2-4a8c7fc611f3 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:41.252275 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-59a5eb26-07c2-4b78-b0e2-4a8c7fc611f3 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:41.423033 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-59a5eb26-07c2-4b78-b0e2-4a8c7fc611f3 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:41.435160 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-59a5eb26-07c2-4b78-b0e2-4a8c7fc611f3 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.197197 Apr 11 16:39:41.436880 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 221/453] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:41 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:41.681597 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-33473c6c-d601-4b93-8472-0d295127580d req-15394e62-0de2-400d-9e4e-c7e275294c93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "494cad61-7e0d-49b6-aa92-6354407d825d", "name": "network-vif-plugged", "status": "completed", "tag": "900247d2-717f-4100-a8c4-2e6811bb9b9b"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:39:41.691034 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-33473c6c-d601-4b93-8472-0d295127580d req-15394e62-0de2-400d-9e4e-c7e275294c93 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:41.691527 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-33473c6c-d601-4b93-8472-0d295127580d req-15394e62-0de2-400d-9e4e-c7e275294c93 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:41.718404 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-33473c6c-d601-4b93-8472-0d295127580d req-15394e62-0de2-400d-9e4e-c7e275294c93 service nova] Creating event network-vif-plugged:900247d2-717f-4100-a8c4-2e6811bb9b9b for instance 494cad61-7e0d-49b6-aa92-6354407d825d on hv-cinder-83716 Apr 11 16:39:41.725715 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-33473c6c-d601-4b93-8472-0d295127580d req-15394e62-0de2-400d-9e4e-c7e275294c93 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047555 Apr 11 16:39:41.726519 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 233/454] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:39:41.993304 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-87fd3e1f-638a-459b-b366-d21b3cd85c34 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:39:41.993855 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-87fd3e1f-638a-459b-b366-d21b3cd85c34 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:42.001683 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-87fd3e1f-638a-459b-b366-d21b3cd85c34 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:42.002130 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-87fd3e1f-638a-459b-b366-d21b3cd85c34 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:42.002941 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-87fd3e1f-638a-459b-b366-d21b3cd85c34 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:42.003372 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-87fd3e1f-638a-459b-b366-d21b3cd85c34 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:42.029730 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.objects.instance [None req-87fd3e1f-638a-459b-b366-d21b3cd85c34 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lazy-loading 'flavor' on Instance uuid f08685e5-3c41-4032-9633-cc591711221a {{(pid=123774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:39:42.297930 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-87fd3e1f-638a-459b-b366-d21b3cd85c34 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "POST /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a/action" status: 202 len: 0 microversion: 2.20 time: 0.308363 Apr 11 16:39:42.298570 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 222/455] 10.222.0.65 () {62 vars in 1318 bytes} [Mon Apr 11 16:39:41 2022] POST /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:39:42.307562 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-40d3670d-ee48-430f-87d5-a969c1908e74 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:42.308279 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-40d3670d-ee48-430f-87d5-a969c1908e74 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:42.315219 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-40d3670d-ee48-430f-87d5-a969c1908e74 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:42.315734 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-40d3670d-ee48-430f-87d5-a969c1908e74 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:42.316508 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-40d3670d-ee48-430f-87d5-a969c1908e74 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:42.316934 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-40d3670d-ee48-430f-87d5-a969c1908e74 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:42.453028 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-40d3670d-ee48-430f-87d5-a969c1908e74 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:42.458980 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-673e2f6e-abbe-43ff-bf81-2cbc7867a83c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:42.459664 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-673e2f6e-abbe-43ff-bf81-2cbc7867a83c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:42.461527 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-40d3670d-ee48-430f-87d5-a969c1908e74 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:42.463072 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-40d3670d-ee48-430f-87d5-a969c1908e74 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:42.464346 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-40d3670d-ee48-430f-87d5-a969c1908e74 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1721 microversion: 2.20 time: 0.161070 Apr 11 16:39:42.464981 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 234/456] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:39:42 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:39:42.475991 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-673e2f6e-abbe-43ff-bf81-2cbc7867a83c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:42.475991 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-673e2f6e-abbe-43ff-bf81-2cbc7867a83c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:42.475991 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-673e2f6e-abbe-43ff-bf81-2cbc7867a83c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:42.475991 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-673e2f6e-abbe-43ff-bf81-2cbc7867a83c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:42.602454 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-673e2f6e-abbe-43ff-bf81-2cbc7867a83c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:42.610753 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-673e2f6e-abbe-43ff-bf81-2cbc7867a83c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1359 microversion: 2.1 time: 0.156049 Apr 11 16:39:42.611375 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 223/457] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:42 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:43.484034 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-64ee7fa2-15b7-46cf-bbd9-27407d797ed5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:43.484612 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-64ee7fa2-15b7-46cf-bbd9-27407d797ed5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:43.491128 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-64ee7fa2-15b7-46cf-bbd9-27407d797ed5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:43.491576 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-64ee7fa2-15b7-46cf-bbd9-27407d797ed5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:43.492374 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-64ee7fa2-15b7-46cf-bbd9-27407d797ed5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:43.492805 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-64ee7fa2-15b7-46cf-bbd9-27407d797ed5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:43.627473 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-64ee7fa2-15b7-46cf-bbd9-27407d797ed5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:43.629263 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-6b068726-5655-4cc3-ab6a-25bc948de6f6 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:43.629885 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-6b068726-5655-4cc3-ab6a-25bc948de6f6 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:43.636860 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6b068726-5655-4cc3-ab6a-25bc948de6f6 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:43.637079 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-64ee7fa2-15b7-46cf-bbd9-27407d797ed5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:43.637332 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6b068726-5655-4cc3-ab6a-25bc948de6f6 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:43.638177 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6b068726-5655-4cc3-ab6a-25bc948de6f6 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:43.638707 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6b068726-5655-4cc3-ab6a-25bc948de6f6 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:43.639305 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-64ee7fa2-15b7-46cf-bbd9-27407d797ed5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:43.640723 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-64ee7fa2-15b7-46cf-bbd9-27407d797ed5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1721 microversion: 2.20 time: 0.160639 Apr 11 16:39:43.648384 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 235/458] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:39:43 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:39:43.772565 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-6b068726-5655-4cc3-ab6a-25bc948de6f6 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:43.780507 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-6b068726-5655-4cc3-ab6a-25bc948de6f6 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1549 microversion: 2.1 time: 0.155705 Apr 11 16:39:43.781093 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 224/459] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:43 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:39:43.797682 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-8d709c21-c8df-4408-b1d3-842a4a2ce55a tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:43.798282 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-8d709c21-c8df-4408-b1d3-842a4a2ce55a tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:43.804505 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8d709c21-c8df-4408-b1d3-842a4a2ce55a tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:43.804940 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8d709c21-c8df-4408-b1d3-842a4a2ce55a tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:43.805694 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8d709c21-c8df-4408-b1d3-842a4a2ce55a tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:43.806120 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8d709c21-c8df-4408-b1d3-842a4a2ce55a tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:43.940512 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-8d709c21-c8df-4408-b1d3-842a4a2ce55a tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:43.949129 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-8d709c21-c8df-4408-b1d3-842a4a2ce55a tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1549 microversion: 2.1 time: 0.155447 Apr 11 16:39:43.949704 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 236/460] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:43 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:43.965349 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-29ab4178-9b3a-485e-b1b4-a801660b24d3 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:43.969050 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-29ab4178-9b3a-485e-b1b4-a801660b24d3 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:43.969818 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-29ab4178-9b3a-485e-b1b4-a801660b24d3 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Searching by: {'deleted': False, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb'} {{(pid=123774) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 11 16:39:43.976888 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-29ab4178-9b3a-485e-b1b4-a801660b24d3 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:43.977312 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-29ab4178-9b3a-485e-b1b4-a801660b24d3 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:43.978120 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-29ab4178-9b3a-485e-b1b4-a801660b24d3 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:43.978548 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-29ab4178-9b3a-485e-b1b4-a801660b24d3 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:44.068698 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.multi_cell_list [None req-29ab4178-9b3a-485e-b1b4-a801660b24d3 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123774) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 11 16:39:44.165403 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-29ab4178-9b3a-485e-b1b4-a801660b24d3 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.203651 Apr 11 16:39:44.165909 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 225/461] 10.222.0.65 () {58 vars in 1124 bytes} [Mon Apr 11 16:39:43 2022] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:39:44.176544 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-5d5165fe-4fd6-44dd-8766-9c4322e4b295 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:44.177168 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-5d5165fe-4fd6-44dd-8766-9c4322e4b295 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:44.184580 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5d5165fe-4fd6-44dd-8766-9c4322e4b295 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:44.185002 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5d5165fe-4fd6-44dd-8766-9c4322e4b295 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:44.185880 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5d5165fe-4fd6-44dd-8766-9c4322e4b295 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:44.186304 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5d5165fe-4fd6-44dd-8766-9c4322e4b295 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:44.316503 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5d5165fe-4fd6-44dd-8766-9c4322e4b295 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:44.324343 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-5d5165fe-4fd6-44dd-8766-9c4322e4b295 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1549 microversion: 2.1 time: 0.151602 Apr 11 16:39:44.324925 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 237/462] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:44 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:44.659614 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-b60825f6-4d48-4046-944c-3be578be8b7c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:44.661122 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-b60825f6-4d48-4046-944c-3be578be8b7c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:44.668841 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b60825f6-4d48-4046-944c-3be578be8b7c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:44.669361 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b60825f6-4d48-4046-944c-3be578be8b7c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:44.670172 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b60825f6-4d48-4046-944c-3be578be8b7c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:44.670657 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b60825f6-4d48-4046-944c-3be578be8b7c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:44.830191 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-b60825f6-4d48-4046-944c-3be578be8b7c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:44.839223 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-b60825f6-4d48-4046-944c-3be578be8b7c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:44.840872 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-b60825f6-4d48-4046-944c-3be578be8b7c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:44.842494 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-b60825f6-4d48-4046-944c-3be578be8b7c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1721 microversion: 2.20 time: 0.187014 Apr 11 16:39:44.843089 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 226/463] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:39:44 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:39:45.861683 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-5f4d08ce-7f5f-4c50-876c-3e8f7b1cc92f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:45.862274 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-5f4d08ce-7f5f-4c50-876c-3e8f7b1cc92f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:45.868531 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5f4d08ce-7f5f-4c50-876c-3e8f7b1cc92f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:45.869004 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5f4d08ce-7f5f-4c50-876c-3e8f7b1cc92f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:45.869776 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5f4d08ce-7f5f-4c50-876c-3e8f7b1cc92f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:45.870188 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5f4d08ce-7f5f-4c50-876c-3e8f7b1cc92f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:45.886993 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d5940105-834b-4476-9535-cbf5c5262b97 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e82ab761-9e55-4750-9249-49870ae74068"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:39:45.888583 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d5940105-834b-4476-9535-cbf5c5262b97 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:45.895661 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d5940105-834b-4476-9535-cbf5c5262b97 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:45.896122 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d5940105-834b-4476-9535-cbf5c5262b97 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:45.896890 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d5940105-834b-4476-9535-cbf5c5262b97 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:45.897313 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d5940105-834b-4476-9535-cbf5c5262b97 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:46.013970 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5f4d08ce-7f5f-4c50-876c-3e8f7b1cc92f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:46.022981 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5f4d08ce-7f5f-4c50-876c-3e8f7b1cc92f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:46.024622 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5f4d08ce-7f5f-4c50-876c-3e8f7b1cc92f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:46.032975 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-5f4d08ce-7f5f-4c50-876c-3e8f7b1cc92f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1721 microversion: 2.20 time: 0.168050 Apr 11 16:39:46.038128 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 238/464] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:39:45 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:39:46.329679 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d5940105-834b-4476-9535-cbf5c5262b97 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "POST /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.446391 Apr 11 16:39:46.330304 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 227/465] 10.222.0.65 () {60 vars in 1322 bytes} [Mon Apr 11 16:39:45 2022] POST /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d/os-volume_attachments => generated 194 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:39:47.051144 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-4d58e630-7c8d-44a0-b6ad-abc58e82ebd3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:47.052487 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-4d58e630-7c8d-44a0-b6ad-abc58e82ebd3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:47.058480 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4d58e630-7c8d-44a0-b6ad-abc58e82ebd3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:47.059007 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4d58e630-7c8d-44a0-b6ad-abc58e82ebd3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:47.059707 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4d58e630-7c8d-44a0-b6ad-abc58e82ebd3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:47.060203 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4d58e630-7c8d-44a0-b6ad-abc58e82ebd3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:47.273416 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-4d58e630-7c8d-44a0-b6ad-abc58e82ebd3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:47.283322 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-4d58e630-7c8d-44a0-b6ad-abc58e82ebd3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:47.284964 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-4d58e630-7c8d-44a0-b6ad-abc58e82ebd3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:47.286111 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-4d58e630-7c8d-44a0-b6ad-abc58e82ebd3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1721 microversion: 2.20 time: 0.238924 Apr 11 16:39:47.286682 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 239/466] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:39:47 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:39:48.306323 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-7cab5d6e-8cfe-4ba0-a0c5-c2bbc95384a7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:48.306982 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-7cab5d6e-8cfe-4ba0-a0c5-c2bbc95384a7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:48.314286 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7cab5d6e-8cfe-4ba0-a0c5-c2bbc95384a7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:48.314728 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7cab5d6e-8cfe-4ba0-a0c5-c2bbc95384a7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:48.315923 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7cab5d6e-8cfe-4ba0-a0c5-c2bbc95384a7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:48.316576 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7cab5d6e-8cfe-4ba0-a0c5-c2bbc95384a7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:48.465522 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-7cab5d6e-8cfe-4ba0-a0c5-c2bbc95384a7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:48.473996 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-7cab5d6e-8cfe-4ba0-a0c5-c2bbc95384a7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:48.475468 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-7cab5d6e-8cfe-4ba0-a0c5-c2bbc95384a7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:48.476656 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-7cab5d6e-8cfe-4ba0-a0c5-c2bbc95384a7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1721 microversion: 2.20 time: 0.175202 Apr 11 16:39:48.477502 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 228/467] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:39:48 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:39:49.292340 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-81ccd57c-3164-4391-93ba-3038f86101b4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-826995297", "imageRef": "e989c938-7b7a-445c-aec9-596e81d35104", "flavorRef": "452", "networks": [{"uuid": "b5c235fd-58a1-4013-a70e-85ace28807d0"}]}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:39:49.344379 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.network.neutron [None req-81ccd57c-3164-4391-93ba-3038f86101b4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] validate_networks() for [('b5c235fd-58a1-4013-a70e-85ace28807d0', None, None, None, None, None)] {{(pid=123773) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:39:49.498993 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-0f84b1a4-d1fb-439d-8208-daf5dca4a82b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:49.500373 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-0f84b1a4-d1fb-439d-8208-daf5dca4a82b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:49.511108 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0f84b1a4-d1fb-439d-8208-daf5dca4a82b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:49.511851 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0f84b1a4-d1fb-439d-8208-daf5dca4a82b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:49.513417 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0f84b1a4-d1fb-439d-8208-daf5dca4a82b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:49.513750 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0f84b1a4-d1fb-439d-8208-daf5dca4a82b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:49.851452 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0f84b1a4-d1fb-439d-8208-daf5dca4a82b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:49.865687 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0f84b1a4-d1fb-439d-8208-daf5dca4a82b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:49.867397 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0f84b1a4-d1fb-439d-8208-daf5dca4a82b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:49.868707 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-0f84b1a4-d1fb-439d-8208-daf5dca4a82b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1721 microversion: 2.20 time: 0.376463 Apr 11 16:39:49.869363 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 229/468] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:39:49 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1721 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:39:50.105118 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-81ccd57c-3164-4391-93ba-3038f86101b4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Flavor limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:39:50.105701 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-81ccd57c-3164-4391-93ba-3038f86101b4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Image limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:39:50.106219 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-81ccd57c-3164-4391-93ba-3038f86101b4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Flavor pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:39:50.106641 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-81ccd57c-3164-4391-93ba-3038f86101b4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Image pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:39:50.107628 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-81ccd57c-3164-4391-93ba-3038f86101b4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:39:50.118595 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-81ccd57c-3164-4391-93ba-3038f86101b4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:50.119036 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-81ccd57c-3164-4391-93ba-3038f86101b4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:50.119855 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-81ccd57c-3164-4391-93ba-3038f86101b4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:50.120308 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-81ccd57c-3164-4391-93ba-3038f86101b4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:50.138331 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-81ccd57c-3164-4391-93ba-3038f86101b4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Getting quotas for project 6d6d2866c13744368b0762634b43a1be. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:39:50.142355 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-81ccd57c-3164-4391-93ba-3038f86101b4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Getting quotas for user 18ec3557c23547689f3a254667fcb27f and project 6d6d2866c13744368b0762634b43a1be. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:39:50.153518 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-81ccd57c-3164-4391-93ba-3038f86101b4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Going to run 1 instances... {{(pid=123773) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:39:50.156148 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-81ccd57c-3164-4391-93ba-3038f86101b4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e989c938-7b7a-445c-aec9-596e81d35104',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:39:50.202905 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-81ccd57c-3164-4391-93ba-3038f86101b4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.914199 Apr 11 16:39:50.207725 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 240/469] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Apr 11 16:39:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 16:39:50.219062 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a043465e-dc37-4d79-b53e-52b80e1338eb tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:50.220246 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a043465e-dc37-4d79-b53e-52b80e1338eb tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:50.286606 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a043465e-dc37-4d79-b53e-52b80e1338eb tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:50.297856 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a043465e-dc37-4d79-b53e-52b80e1338eb tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a" status: 200 len: 1218 microversion: 2.1 time: 0.086215 Apr 11 16:39:50.298823 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 230/470] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:50 2022] GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:50.895762 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-5b87df99-ae5d-4479-87eb-56a5e2fba2b5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:50.896349 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-5b87df99-ae5d-4479-87eb-56a5e2fba2b5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:50.903719 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5b87df99-ae5d-4479-87eb-56a5e2fba2b5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:50.904404 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5b87df99-ae5d-4479-87eb-56a5e2fba2b5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:50.905296 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5b87df99-ae5d-4479-87eb-56a5e2fba2b5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:50.905732 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5b87df99-ae5d-4479-87eb-56a5e2fba2b5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:51.042609 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5b87df99-ae5d-4479-87eb-56a5e2fba2b5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:51.051926 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5b87df99-ae5d-4479-87eb-56a5e2fba2b5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:51.053686 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5b87df99-ae5d-4479-87eb-56a5e2fba2b5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:51.055311 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-5b87df99-ae5d-4479-87eb-56a5e2fba2b5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1721 microversion: 2.20 time: 0.163773 Apr 11 16:39:51.056111 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 241/471] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:39:50 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:39:51.322866 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-85c31daf-f5f6-4b5c-91b1-fd3444cda247 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:51.323536 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-85c31daf-f5f6-4b5c-91b1-fd3444cda247 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:51.332010 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-85c31daf-f5f6-4b5c-91b1-fd3444cda247 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:51.332335 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-85c31daf-f5f6-4b5c-91b1-fd3444cda247 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:51.333853 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-85c31daf-f5f6-4b5c-91b1-fd3444cda247 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:51.334333 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-85c31daf-f5f6-4b5c-91b1-fd3444cda247 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:51.441844 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-85c31daf-f5f6-4b5c-91b1-fd3444cda247 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:51.453228 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-85c31daf-f5f6-4b5c-91b1-fd3444cda247 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a" status: 200 len: 1278 microversion: 2.1 time: 0.134290 Apr 11 16:39:51.463680 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 231/472] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:51 2022] GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a => generated 1278 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:51.633079 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-97c64e42-2c64-4b77-a6b9-1178650cd0db tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:51.633692 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-97c64e42-2c64-4b77-a6b9-1178650cd0db tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:51.640378 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-97c64e42-2c64-4b77-a6b9-1178650cd0db tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:51.640925 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-97c64e42-2c64-4b77-a6b9-1178650cd0db tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:51.641977 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-97c64e42-2c64-4b77-a6b9-1178650cd0db tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:51.642416 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-97c64e42-2c64-4b77-a6b9-1178650cd0db tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:51.672073 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-97c64e42-2c64-4b77-a6b9-1178650cd0db tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768/ips" status: 200 len: 147 microversion: 2.1 time: 0.042935 Apr 11 16:39:51.672684 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 242/473] 10.222.0.65 () {58 vars in 1247 bytes} [Mon Apr 11 16:39:51 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768/ips => generated 147 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:39:52.075120 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-93ec64a5-be0d-48d3-87fc-b8ff5c7fbf04 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:52.075929 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-93ec64a5-be0d-48d3-87fc-b8ff5c7fbf04 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:52.082493 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-93ec64a5-be0d-48d3-87fc-b8ff5c7fbf04 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:52.082939 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-93ec64a5-be0d-48d3-87fc-b8ff5c7fbf04 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:52.083761 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-93ec64a5-be0d-48d3-87fc-b8ff5c7fbf04 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:52.084192 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-93ec64a5-be0d-48d3-87fc-b8ff5c7fbf04 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:52.222654 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-93ec64a5-be0d-48d3-87fc-b8ff5c7fbf04 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:52.231188 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-93ec64a5-be0d-48d3-87fc-b8ff5c7fbf04 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:52.233193 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-93ec64a5-be0d-48d3-87fc-b8ff5c7fbf04 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:52.234540 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-93ec64a5-be0d-48d3-87fc-b8ff5c7fbf04 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1721 microversion: 2.20 time: 0.163738 Apr 11 16:39:52.235126 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 232/474] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:39:52 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:39:52.479952 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ca459a3e-c004-4cbb-aabc-556750329c01 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:52.480575 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ca459a3e-c004-4cbb-aabc-556750329c01 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:52.487567 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ca459a3e-c004-4cbb-aabc-556750329c01 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:52.488041 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ca459a3e-c004-4cbb-aabc-556750329c01 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:52.488808 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ca459a3e-c004-4cbb-aabc-556750329c01 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:52.489232 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ca459a3e-c004-4cbb-aabc-556750329c01 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:52.626608 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ca459a3e-c004-4cbb-aabc-556750329c01 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:52.634926 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ca459a3e-c004-4cbb-aabc-556750329c01 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a" status: 200 len: 1318 microversion: 2.1 time: 0.158572 Apr 11 16:39:52.635277 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 243/475] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:52 2022] GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:53.260102 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c8b101cf-8726-49ad-9144-2d691e47b55e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:53.260721 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c8b101cf-8726-49ad-9144-2d691e47b55e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:53.268415 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c8b101cf-8726-49ad-9144-2d691e47b55e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:53.268865 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c8b101cf-8726-49ad-9144-2d691e47b55e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:53.269663 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c8b101cf-8726-49ad-9144-2d691e47b55e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:53.270092 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c8b101cf-8726-49ad-9144-2d691e47b55e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:53.483377 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c8b101cf-8726-49ad-9144-2d691e47b55e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:53.505371 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c8b101cf-8726-49ad-9144-2d691e47b55e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:53.508987 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c8b101cf-8726-49ad-9144-2d691e47b55e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:53.511197 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c8b101cf-8726-49ad-9144-2d691e47b55e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1721 microversion: 2.20 time: 0.256463 Apr 11 16:39:53.512588 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 233/476] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:39:53 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:39:53.570137 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-802c9d15-cd0a-4ec9-a80d-df3e809e00c0 req-aa7e8d01-d8f9-40fe-95e6-2b0c4c7e8bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0822de2-ba61-4e09-985e-efdbc3fb523a", "tag": "83db28d4-bc87-43b7-b0cf-a32332df89a5"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:39:53.585567 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-802c9d15-cd0a-4ec9-a80d-df3e809e00c0 req-aa7e8d01-d8f9-40fe-95e6-2b0c4c7e8bd6 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:53.586873 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-802c9d15-cd0a-4ec9-a80d-df3e809e00c0 req-aa7e8d01-d8f9-40fe-95e6-2b0c4c7e8bd6 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:53.612977 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-802c9d15-cd0a-4ec9-a80d-df3e809e00c0 req-aa7e8d01-d8f9-40fe-95e6-2b0c4c7e8bd6 service nova] Creating event network-changed:83db28d4-bc87-43b7-b0cf-a32332df89a5 for instance a0822de2-ba61-4e09-985e-efdbc3fb523a on hv-cinder-83716 Apr 11 16:39:53.621707 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-802c9d15-cd0a-4ec9-a80d-df3e809e00c0 req-aa7e8d01-d8f9-40fe-95e6-2b0c4c7e8bd6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055494 Apr 11 16:39:53.623187 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 244/477] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:39:53.652567 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5a7eac34-25e4-4985-8010-c21dbfebf575 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:53.653199 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5a7eac34-25e4-4985-8010-c21dbfebf575 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:53.663113 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5a7eac34-25e4-4985-8010-c21dbfebf575 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:53.663741 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5a7eac34-25e4-4985-8010-c21dbfebf575 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:53.664979 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5a7eac34-25e4-4985-8010-c21dbfebf575 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:53.665752 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5a7eac34-25e4-4985-8010-c21dbfebf575 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:53.998666 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5a7eac34-25e4-4985-8010-c21dbfebf575 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:54.007246 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-7b984376-f54e-430f-bc91-e2cd172a1d19 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc9aa79a-7c7a-4675-8028-78b4cdadabdb"}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:39:54.007980 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5a7eac34-25e4-4985-8010-c21dbfebf575 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a" status: 200 len: 1318 microversion: 2.1 time: 0.359262 Apr 11 16:39:54.010470 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-7b984376-f54e-430f-bc91-e2cd172a1d19 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:54.018502 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 234/478] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:53 2022] GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:54.022712 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7b984376-f54e-430f-bc91-e2cd172a1d19 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:54.023560 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7b984376-f54e-430f-bc91-e2cd172a1d19 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:54.024564 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7b984376-f54e-430f-bc91-e2cd172a1d19 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:54.025214 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7b984376-f54e-430f-bc91-e2cd172a1d19 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:54.047466 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-fd70cd94-b87c-449e-8fbb-9e6cc8af325c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:54.048106 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-fd70cd94-b87c-449e-8fbb-9e6cc8af325c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:54.055057 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fd70cd94-b87c-449e-8fbb-9e6cc8af325c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:54.055496 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fd70cd94-b87c-449e-8fbb-9e6cc8af325c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:54.056494 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fd70cd94-b87c-449e-8fbb-9e6cc8af325c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:54.057072 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fd70cd94-b87c-449e-8fbb-9e6cc8af325c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:54.339306 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-fd70cd94-b87c-449e-8fbb-9e6cc8af325c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:54.353701 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-fd70cd94-b87c-449e-8fbb-9e6cc8af325c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1595 microversion: 2.1 time: 0.310896 Apr 11 16:39:54.366433 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 235/479] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:54 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1595 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:54.443027 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-7b984376-f54e-430f-bc91-e2cd172a1d19 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "POST /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.444720 Apr 11 16:39:54.443868 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 245/480] 10.222.0.65 () {60 vars in 1322 bytes} [Mon Apr 11 16:39:53 2022] POST /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768/os-volume_attachments => generated 194 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:39:54.544332 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-18c4c481-c5a6-4768-87b6-116c98b2017b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:54.545442 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-18c4c481-c5a6-4768-87b6-116c98b2017b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:54.554420 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-18c4c481-c5a6-4768-87b6-116c98b2017b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:54.555016 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-18c4c481-c5a6-4768-87b6-116c98b2017b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:54.556232 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-18c4c481-c5a6-4768-87b6-116c98b2017b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:54.556815 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-18c4c481-c5a6-4768-87b6-116c98b2017b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:54.808823 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-18c4c481-c5a6-4768-87b6-116c98b2017b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:54.819900 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-18c4c481-c5a6-4768-87b6-116c98b2017b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:54.821914 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-18c4c481-c5a6-4768-87b6-116c98b2017b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:54.823323 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-18c4c481-c5a6-4768-87b6-116c98b2017b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1721 microversion: 2.20 time: 0.286482 Apr 11 16:39:54.824064 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 236/481] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:39:54 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1721 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:39:55.028747 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-29f9b525-28ec-4bcb-998a-26b2f95a8014 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:55.031174 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-29f9b525-28ec-4bcb-998a-26b2f95a8014 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:55.043024 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-29f9b525-28ec-4bcb-998a-26b2f95a8014 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:55.044186 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-29f9b525-28ec-4bcb-998a-26b2f95a8014 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:55.045595 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-29f9b525-28ec-4bcb-998a-26b2f95a8014 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:55.046529 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-29f9b525-28ec-4bcb-998a-26b2f95a8014 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:55.266946 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-29f9b525-28ec-4bcb-998a-26b2f95a8014 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:55.277630 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-29f9b525-28ec-4bcb-998a-26b2f95a8014 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a" status: 200 len: 1318 microversion: 2.1 time: 0.254945 Apr 11 16:39:55.278330 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 246/482] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:55 2022] GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:55.853301 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-b51f687b-33ed-4951-b462-f3ff2a24c36b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:55.854426 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-b51f687b-33ed-4951-b462-f3ff2a24c36b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:55.865910 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b51f687b-33ed-4951-b462-f3ff2a24c36b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:55.866675 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b51f687b-33ed-4951-b462-f3ff2a24c36b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:55.868024 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b51f687b-33ed-4951-b462-f3ff2a24c36b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:55.868759 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b51f687b-33ed-4951-b462-f3ff2a24c36b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:56.119676 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-b51f687b-33ed-4951-b462-f3ff2a24c36b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:56.133344 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-b51f687b-33ed-4951-b462-f3ff2a24c36b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:56.135388 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-b51f687b-33ed-4951-b462-f3ff2a24c36b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:56.137077 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-b51f687b-33ed-4951-b462-f3ff2a24c36b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1721 microversion: 2.20 time: 0.289983 Apr 11 16:39:56.137864 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 237/483] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:39:55 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:39:56.307295 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c577a202-e66e-4f92-8fc7-a2ba200d1fb8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:56.308224 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c577a202-e66e-4f92-8fc7-a2ba200d1fb8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:56.319620 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c577a202-e66e-4f92-8fc7-a2ba200d1fb8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:56.320335 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c577a202-e66e-4f92-8fc7-a2ba200d1fb8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:56.321788 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c577a202-e66e-4f92-8fc7-a2ba200d1fb8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:56.322570 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c577a202-e66e-4f92-8fc7-a2ba200d1fb8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:56.933743 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c577a202-e66e-4f92-8fc7-a2ba200d1fb8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:56.947115 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c577a202-e66e-4f92-8fc7-a2ba200d1fb8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a" status: 200 len: 1318 microversion: 2.1 time: 0.645458 Apr 11 16:39:56.948213 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 247/484] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:56 2022] GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a => generated 1318 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:39:57.166328 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-838037de-e1bf-43d6-954d-35ceccde65a0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:57.168986 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-838037de-e1bf-43d6-954d-35ceccde65a0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:57.194994 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-838037de-e1bf-43d6-954d-35ceccde65a0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:57.196976 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-838037de-e1bf-43d6-954d-35ceccde65a0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:57.199205 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-838037de-e1bf-43d6-954d-35ceccde65a0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:57.200690 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-838037de-e1bf-43d6-954d-35ceccde65a0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:57.289619 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-e19d5da3-52f4-42c5-98b7-8db409b211e7 req-a3c240b7-7b5c-44e4-8eac-ce8dae6090c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "494cad61-7e0d-49b6-aa92-6354407d825d", "tag": "900247d2-717f-4100-a8c4-2e6811bb9b9b"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:39:57.308115 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-e19d5da3-52f4-42c5-98b7-8db409b211e7 req-a3c240b7-7b5c-44e4-8eac-ce8dae6090c5 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:57.310162 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-e19d5da3-52f4-42c5-98b7-8db409b211e7 req-a3c240b7-7b5c-44e4-8eac-ce8dae6090c5 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:57.334728 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-e19d5da3-52f4-42c5-98b7-8db409b211e7 req-a3c240b7-7b5c-44e4-8eac-ce8dae6090c5 service nova] Creating event network-changed:900247d2-717f-4100-a8c4-2e6811bb9b9b for instance 494cad61-7e0d-49b6-aa92-6354407d825d on hv-cinder-83716 Apr 11 16:39:57.342397 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-e19d5da3-52f4-42c5-98b7-8db409b211e7 req-a3c240b7-7b5c-44e4-8eac-ce8dae6090c5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059321 Apr 11 16:39:57.343696 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 248/485] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:39:57.655225 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-838037de-e1bf-43d6-954d-35ceccde65a0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:57.672388 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-838037de-e1bf-43d6-954d-35ceccde65a0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:57.677254 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-838037de-e1bf-43d6-954d-35ceccde65a0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:57.682364 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-838037de-e1bf-43d6-954d-35ceccde65a0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1721 microversion: 2.20 time: 0.526975 Apr 11 16:39:57.684223 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 238/486] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:39:57 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1721 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:39:57.976056 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-fba92669-316f-4ccf-b962-f073161138be tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:57.977409 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-fba92669-316f-4ccf-b962-f073161138be tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:57.989394 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fba92669-316f-4ccf-b962-f073161138be tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:57.990142 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fba92669-316f-4ccf-b962-f073161138be tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:57.992242 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fba92669-316f-4ccf-b962-f073161138be tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:57.993781 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fba92669-316f-4ccf-b962-f073161138be tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:58.538852 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-fba92669-316f-4ccf-b962-f073161138be tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:58.561944 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-fba92669-316f-4ccf-b962-f073161138be tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a" status: 200 len: 1318 microversion: 2.1 time: 0.592185 Apr 11 16:39:58.563923 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 249/487] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:57 2022] GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a => generated 1318 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:39:58.725064 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-9687d444-4844-4817-93e3-38c7b1de06bc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:58.726899 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-9687d444-4844-4817-93e3-38c7b1de06bc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:58.739130 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9687d444-4844-4817-93e3-38c7b1de06bc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:58.740039 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9687d444-4844-4817-93e3-38c7b1de06bc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:58.741901 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9687d444-4844-4817-93e3-38c7b1de06bc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:58.742648 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9687d444-4844-4817-93e3-38c7b1de06bc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:58.995600 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-9687d444-4844-4817-93e3-38c7b1de06bc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:59.011989 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-9687d444-4844-4817-93e3-38c7b1de06bc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:59.014684 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-9687d444-4844-4817-93e3-38c7b1de06bc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:59.016070 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-9687d444-4844-4817-93e3-38c7b1de06bc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1721 microversion: 2.20 time: 0.300017 Apr 11 16:39:59.016798 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 239/488] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:39:58 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1721 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:39:59.570202 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-87b7072a-5455-4394-8c67-a2743fea4f95 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1194086937"}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:39:59.572573 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-87b7072a-5455-4394-8c67-a2743fea4f95 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:59.592460 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-4d292687-3fa7-43c7-afb8-11e176f022df tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:39:59.593293 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-4d292687-3fa7-43c7-afb8-11e176f022df tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:39:59.599952 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-87b7072a-5455-4394-8c67-a2743fea4f95 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:59.600534 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-87b7072a-5455-4394-8c67-a2743fea4f95 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:59.601425 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-87b7072a-5455-4394-8c67-a2743fea4f95 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:59.602057 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-87b7072a-5455-4394-8c67-a2743fea4f95 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:59.613865 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4d292687-3fa7-43c7-afb8-11e176f022df tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:59.614627 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4d292687-3fa7-43c7-afb8-11e176f022df tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:59.616094 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4d292687-3fa7-43c7-afb8-11e176f022df tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:39:59.616775 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4d292687-3fa7-43c7-afb8-11e176f022df tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:39:59.908003 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.network.security_group_api [None req-87b7072a-5455-4394-8c67-a2743fea4f95 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Adding security group 53fb903d-63ec-4004-a1fb-7695785c7fae to port 900247d2-717f-4100-a8c4-2e6811bb9b9b Apr 11 16:39:59.914688 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-4d292687-3fa7-43c7-afb8-11e176f022df tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:39:59.924740 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-4d292687-3fa7-43c7-afb8-11e176f022df tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a" status: 200 len: 1318 microversion: 2.1 time: 0.337292 Apr 11 16:39:59.926001 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 240/489] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:39:59 2022] GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:00.036803 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-3ee4577a-bd7d-4ccf-808c-ab11484b696a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:00.037625 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-3ee4577a-bd7d-4ccf-808c-ab11484b696a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:00.048787 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3ee4577a-bd7d-4ccf-808c-ab11484b696a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:00.049857 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3ee4577a-bd7d-4ccf-808c-ab11484b696a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:00.050677 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3ee4577a-bd7d-4ccf-808c-ab11484b696a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:00.051122 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3ee4577a-bd7d-4ccf-808c-ab11484b696a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:00.350713 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-3ee4577a-bd7d-4ccf-808c-ab11484b696a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:00.359939 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-3ee4577a-bd7d-4ccf-808c-ab11484b696a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:00.361404 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-3ee4577a-bd7d-4ccf-808c-ab11484b696a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:00.362633 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-3ee4577a-bd7d-4ccf-808c-ab11484b696a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1742 microversion: 2.20 time: 0.330153 Apr 11 16:40:00.363499 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 241/490] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:00 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1742 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:40:00.639386 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-87b7072a-5455-4394-8c67-a2743fea4f95 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "POST /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d/action" status: 202 len: 0 microversion: 2.1 time: 1.077273 Apr 11 16:40:00.645695 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 250/491] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Apr 11 16:39:59 2022] POST /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d/action => generated 0 bytes in 1085 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 16:40:00.651587 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-291d6989-c289-4b32-8289-6a23cd4038ce tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:00.652479 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-291d6989-c289-4b32-8289-6a23cd4038ce tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:00.660539 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-291d6989-c289-4b32-8289-6a23cd4038ce tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:00.661289 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-291d6989-c289-4b32-8289-6a23cd4038ce tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:00.662339 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-291d6989-c289-4b32-8289-6a23cd4038ce tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:00.662956 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-291d6989-c289-4b32-8289-6a23cd4038ce tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:00.663932 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-033e923c-3199-47c6-9bf6-38346561e21d req-ba3900cb-2856-482b-ba21-8adbe5df37b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "494cad61-7e0d-49b6-aa92-6354407d825d", "tag": "900247d2-717f-4100-a8c4-2e6811bb9b9b"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:40:00.684232 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-033e923c-3199-47c6-9bf6-38346561e21d req-ba3900cb-2856-482b-ba21-8adbe5df37b2 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:00.686017 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-033e923c-3199-47c6-9bf6-38346561e21d req-ba3900cb-2856-482b-ba21-8adbe5df37b2 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:00.710594 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-033e923c-3199-47c6-9bf6-38346561e21d req-ba3900cb-2856-482b-ba21-8adbe5df37b2 service nova] Creating event network-changed:900247d2-717f-4100-a8c4-2e6811bb9b9b for instance 494cad61-7e0d-49b6-aa92-6354407d825d on hv-cinder-83716 Apr 11 16:40:00.722149 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-033e923c-3199-47c6-9bf6-38346561e21d req-ba3900cb-2856-482b-ba21-8adbe5df37b2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064799 Apr 11 16:40:00.724211 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 251/492] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:40:00.945330 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-a9e51db9-7c93-4ac7-9590-1e01386623c1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:00.946565 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-a9e51db9-7c93-4ac7-9590-1e01386623c1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:00.960132 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a9e51db9-7c93-4ac7-9590-1e01386623c1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:00.960976 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a9e51db9-7c93-4ac7-9590-1e01386623c1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:00.962350 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a9e51db9-7c93-4ac7-9590-1e01386623c1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:00.963123 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a9e51db9-7c93-4ac7-9590-1e01386623c1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:01.122754 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-291d6989-c289-4b32-8289-6a23cd4038ce tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:01.136700 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-291d6989-c289-4b32-8289-6a23cd4038ce tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1761 microversion: 2.1 time: 0.489902 Apr 11 16:40:01.137623 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 242/493] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:00 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1761 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:40:01.295575 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-a9e51db9-7c93-4ac7-9590-1e01386623c1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:01.304029 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-a9e51db9-7c93-4ac7-9590-1e01386623c1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a" status: 200 len: 1318 microversion: 2.1 time: 0.364687 Apr 11 16:40:01.304693 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 252/494] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:00 2022] GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:40:01.385244 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-62aa6fa1-2fb0-4be3-a2f4-49a2fc496848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:01.386283 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-62aa6fa1-2fb0-4be3-a2f4-49a2fc496848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:01.397813 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-62aa6fa1-2fb0-4be3-a2f4-49a2fc496848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:01.398598 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-62aa6fa1-2fb0-4be3-a2f4-49a2fc496848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:01.400050 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-62aa6fa1-2fb0-4be3-a2f4-49a2fc496848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:01.400832 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-62aa6fa1-2fb0-4be3-a2f4-49a2fc496848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:01.667402 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-62aa6fa1-2fb0-4be3-a2f4-49a2fc496848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:01.682569 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-62aa6fa1-2fb0-4be3-a2f4-49a2fc496848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:01.685656 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-62aa6fa1-2fb0-4be3-a2f4-49a2fc496848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:01.687876 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-62aa6fa1-2fb0-4be3-a2f4-49a2fc496848 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1742 microversion: 2.20 time: 0.308787 Apr 11 16:40:01.689161 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 243/495] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:01 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1742 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:40:02.326286 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-68a2c7b2-f848-4a87-a509-c7012b3a02b1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:02.327267 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-68a2c7b2-f848-4a87-a509-c7012b3a02b1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:02.338772 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-68a2c7b2-f848-4a87-a509-c7012b3a02b1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:02.339494 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-68a2c7b2-f848-4a87-a509-c7012b3a02b1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:02.341181 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-68a2c7b2-f848-4a87-a509-c7012b3a02b1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:02.342193 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-68a2c7b2-f848-4a87-a509-c7012b3a02b1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:02.536180 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-68a2c7b2-f848-4a87-a509-c7012b3a02b1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:02.549676 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-68a2c7b2-f848-4a87-a509-c7012b3a02b1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a" status: 200 len: 1318 microversion: 2.1 time: 0.230309 Apr 11 16:40:02.550547 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 253/496] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:02 2022] GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:02.718100 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-11fcc5de-5412-4ad5-bcd5-fec93a7640dc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:02.719969 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-11fcc5de-5412-4ad5-bcd5-fec93a7640dc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:02.727526 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-11fcc5de-5412-4ad5-bcd5-fec93a7640dc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:02.728144 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-11fcc5de-5412-4ad5-bcd5-fec93a7640dc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:02.729046 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-11fcc5de-5412-4ad5-bcd5-fec93a7640dc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:02.729574 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-11fcc5de-5412-4ad5-bcd5-fec93a7640dc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:02.901780 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-11fcc5de-5412-4ad5-bcd5-fec93a7640dc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:02.911853 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-11fcc5de-5412-4ad5-bcd5-fec93a7640dc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:02.913573 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-11fcc5de-5412-4ad5-bcd5-fec93a7640dc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:02.915366 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-11fcc5de-5412-4ad5-bcd5-fec93a7640dc tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1742 microversion: 2.20 time: 0.202283 Apr 11 16:40:02.916200 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 244/497] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:02 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1742 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:03.038661 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-1386e921-c399-44cb-9643-6761180fb9de req-2a26bbb8-8160-4e7a-aaf7-921ff65f1b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0822de2-ba61-4e09-985e-efdbc3fb523a", "name": "network-vif-plugged", "status": "completed", "tag": "83db28d4-bc87-43b7-b0cf-a32332df89a5"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:40:03.051937 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-1386e921-c399-44cb-9643-6761180fb9de req-2a26bbb8-8160-4e7a-aaf7-921ff65f1b86 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:03.052707 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-1386e921-c399-44cb-9643-6761180fb9de req-2a26bbb8-8160-4e7a-aaf7-921ff65f1b86 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:03.066930 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-1386e921-c399-44cb-9643-6761180fb9de req-2a26bbb8-8160-4e7a-aaf7-921ff65f1b86 service nova] Creating event network-vif-plugged:83db28d4-bc87-43b7-b0cf-a32332df89a5 for instance a0822de2-ba61-4e09-985e-efdbc3fb523a on hv-cinder-83716 Apr 11 16:40:03.072960 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-1386e921-c399-44cb-9643-6761180fb9de req-2a26bbb8-8160-4e7a-aaf7-921ff65f1b86 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039340 Apr 11 16:40:03.073860 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 254/498] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:40:03.572380 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c8e4d3ce-fdab-4e67-8cc3-9f245dc184ba tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:03.573296 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c8e4d3ce-fdab-4e67-8cc3-9f245dc184ba tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:03.583625 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c8e4d3ce-fdab-4e67-8cc3-9f245dc184ba tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:03.584437 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c8e4d3ce-fdab-4e67-8cc3-9f245dc184ba tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:03.585802 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c8e4d3ce-fdab-4e67-8cc3-9f245dc184ba tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:03.586549 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c8e4d3ce-fdab-4e67-8cc3-9f245dc184ba tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:03.739080 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c8e4d3ce-fdab-4e67-8cc3-9f245dc184ba tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:03.748507 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c8e4d3ce-fdab-4e67-8cc3-9f245dc184ba tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a" status: 200 len: 1318 microversion: 2.1 time: 0.182786 Apr 11 16:40:03.749200 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 245/499] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:03 2022] GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:03.936274 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b5959b79-7ff8-48cb-b149-ca5a7ec74b85 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:03.937050 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b5959b79-7ff8-48cb-b149-ca5a7ec74b85 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:03.944852 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b5959b79-7ff8-48cb-b149-ca5a7ec74b85 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:03.945359 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b5959b79-7ff8-48cb-b149-ca5a7ec74b85 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:03.946289 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b5959b79-7ff8-48cb-b149-ca5a7ec74b85 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:03.946802 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b5959b79-7ff8-48cb-b149-ca5a7ec74b85 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:04.105848 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b5959b79-7ff8-48cb-b149-ca5a7ec74b85 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:04.120871 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b5959b79-7ff8-48cb-b149-ca5a7ec74b85 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:04.122550 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b5959b79-7ff8-48cb-b149-ca5a7ec74b85 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:04.123974 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b5959b79-7ff8-48cb-b149-ca5a7ec74b85 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1742 microversion: 2.20 time: 0.192633 Apr 11 16:40:04.125365 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 255/500] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:03 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1742 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:04.772375 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a82a576e-1f30-457d-ab83-75d2e1b74a36 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:04.773518 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a82a576e-1f30-457d-ab83-75d2e1b74a36 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:04.785242 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a82a576e-1f30-457d-ab83-75d2e1b74a36 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:04.785649 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a82a576e-1f30-457d-ab83-75d2e1b74a36 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:04.786693 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a82a576e-1f30-457d-ab83-75d2e1b74a36 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:04.787350 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a82a576e-1f30-457d-ab83-75d2e1b74a36 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:05.019377 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a82a576e-1f30-457d-ab83-75d2e1b74a36 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:05.033558 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a82a576e-1f30-457d-ab83-75d2e1b74a36 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a" status: 200 len: 1318 microversion: 2.1 time: 0.268024 Apr 11 16:40:05.035138 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 246/501] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:04 2022] GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:05.103923 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-2bb3d804-3e7f-40b5-bbe7-820178df0239 req-6d6cf4ad-d77b-4d20-95fd-a0a257138990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08685e5-3c41-4032-9633-cc591711221a", "name": "network-vif-plugged", "status": "completed", "tag": "8b85453b-0363-47d5-9902-93d848d7263e"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:40:05.120185 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-2bb3d804-3e7f-40b5-bbe7-820178df0239 req-6d6cf4ad-d77b-4d20-95fd-a0a257138990 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:05.120982 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-2bb3d804-3e7f-40b5-bbe7-820178df0239 req-6d6cf4ad-d77b-4d20-95fd-a0a257138990 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:05.145114 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-7ea6fb9d-8ca4-4a80-81a6-b716675dc6cf tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:05.145402 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-2bb3d804-3e7f-40b5-bbe7-820178df0239 req-6d6cf4ad-d77b-4d20-95fd-a0a257138990 service nova] Creating event network-vif-plugged:8b85453b-0363-47d5-9902-93d848d7263e for instance f08685e5-3c41-4032-9633-cc591711221a on hv-cinder-83716 Apr 11 16:40:05.145956 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-7ea6fb9d-8ca4-4a80-81a6-b716675dc6cf tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:05.153276 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-2bb3d804-3e7f-40b5-bbe7-820178df0239 req-6d6cf4ad-d77b-4d20-95fd-a0a257138990 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056602 Apr 11 16:40:05.153870 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 256/502] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:40:05.154950 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7ea6fb9d-8ca4-4a80-81a6-b716675dc6cf tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:05.155756 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7ea6fb9d-8ca4-4a80-81a6-b716675dc6cf tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:05.157269 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7ea6fb9d-8ca4-4a80-81a6-b716675dc6cf tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:05.157958 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7ea6fb9d-8ca4-4a80-81a6-b716675dc6cf tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:05.308021 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-7ea6fb9d-8ca4-4a80-81a6-b716675dc6cf tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:05.321121 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-7ea6fb9d-8ca4-4a80-81a6-b716675dc6cf tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:05.323760 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-7ea6fb9d-8ca4-4a80-81a6-b716675dc6cf tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:05.325741 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-7ea6fb9d-8ca4-4a80-81a6-b716675dc6cf tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1742 microversion: 2.20 time: 0.185607 Apr 11 16:40:05.327061 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 247/503] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:05 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1742 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:40:05.453200 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-40b2306e-d179-4eaf-b06e-55b4d302f31c tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:40:05.462889 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-40b2306e-d179-4eaf-b06e-55b4d302f31c tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:05.463665 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-40b2306e-d179-4eaf-b06e-55b4d302f31c tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:05.554879 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-40b2306e-d179-4eaf-b06e-55b4d302f31c tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Going to try to stop instance {{(pid=123773) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 11 16:40:05.602899 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-40b2306e-d179-4eaf-b06e-55b4d302f31c tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "POST /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768/action" status: 202 len: 0 microversion: 2.1 time: 0.153884 Apr 11 16:40:05.603547 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 257/504] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Apr 11 16:40:05 2022] POST /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:40:05.616074 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d7266442-7cf6-4b12-b699-2effc6ab6356 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:05.617131 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d7266442-7cf6-4b12-b699-2effc6ab6356 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:05.626639 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d7266442-7cf6-4b12-b699-2effc6ab6356 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:05.627210 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d7266442-7cf6-4b12-b699-2effc6ab6356 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:05.628235 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d7266442-7cf6-4b12-b699-2effc6ab6356 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:05.628879 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d7266442-7cf6-4b12-b699-2effc6ab6356 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:05.771626 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d7266442-7cf6-4b12-b699-2effc6ab6356 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:05.780461 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d7266442-7cf6-4b12-b699-2effc6ab6356 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1725 microversion: 2.1 time: 0.171728 Apr 11 16:40:05.781277 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 248/505] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:05 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:40:06.053654 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-8439aa1b-f139-4209-8af7-6e20ba52a7e8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:06.054354 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-8439aa1b-f139-4209-8af7-6e20ba52a7e8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:06.062260 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8439aa1b-f139-4209-8af7-6e20ba52a7e8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:06.062754 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8439aa1b-f139-4209-8af7-6e20ba52a7e8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:06.063576 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8439aa1b-f139-4209-8af7-6e20ba52a7e8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:06.064074 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8439aa1b-f139-4209-8af7-6e20ba52a7e8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:06.220354 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-8439aa1b-f139-4209-8af7-6e20ba52a7e8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:06.233785 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-8439aa1b-f139-4209-8af7-6e20ba52a7e8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a" status: 200 len: 1318 microversion: 2.1 time: 0.184155 Apr 11 16:40:06.234760 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 258/506] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:06 2022] GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:06.355031 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5e82e955-67ec-49e7-a7e2-eb6b72a8387f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:06.355541 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5e82e955-67ec-49e7-a7e2-eb6b72a8387f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:06.362993 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5e82e955-67ec-49e7-a7e2-eb6b72a8387f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:06.363601 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5e82e955-67ec-49e7-a7e2-eb6b72a8387f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:06.364411 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5e82e955-67ec-49e7-a7e2-eb6b72a8387f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:06.364859 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5e82e955-67ec-49e7-a7e2-eb6b72a8387f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:06.551326 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5e82e955-67ec-49e7-a7e2-eb6b72a8387f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:06.560756 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5e82e955-67ec-49e7-a7e2-eb6b72a8387f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:06.562262 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5e82e955-67ec-49e7-a7e2-eb6b72a8387f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:06.563485 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5e82e955-67ec-49e7-a7e2-eb6b72a8387f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1742 microversion: 2.20 time: 0.212798 Apr 11 16:40:06.564097 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 249/507] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:06 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1742 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:06.799343 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-359ef3a5-8c43-4772-9365-9a2404b89232 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:06.800039 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-359ef3a5-8c43-4772-9365-9a2404b89232 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:06.806802 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-359ef3a5-8c43-4772-9365-9a2404b89232 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:06.807390 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-359ef3a5-8c43-4772-9365-9a2404b89232 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:06.808281 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-359ef3a5-8c43-4772-9365-9a2404b89232 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:06.808746 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-359ef3a5-8c43-4772-9365-9a2404b89232 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:06.950696 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-359ef3a5-8c43-4772-9365-9a2404b89232 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:06.959864 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-359ef3a5-8c43-4772-9365-9a2404b89232 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1725 microversion: 2.1 time: 0.164567 Apr 11 16:40:06.960733 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 259/508] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:06 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:07.264705 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-3b12b520-0872-4dd6-a48f-560bbe3ccc82 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:07.265692 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-3b12b520-0872-4dd6-a48f-560bbe3ccc82 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:07.276329 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3b12b520-0872-4dd6-a48f-560bbe3ccc82 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:07.277583 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3b12b520-0872-4dd6-a48f-560bbe3ccc82 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:07.279350 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3b12b520-0872-4dd6-a48f-560bbe3ccc82 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:07.280025 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3b12b520-0872-4dd6-a48f-560bbe3ccc82 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:07.468084 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-3b12b520-0872-4dd6-a48f-560bbe3ccc82 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:07.477773 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-3b12b520-0872-4dd6-a48f-560bbe3ccc82 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a" status: 200 len: 1507 microversion: 2.1 time: 0.220390 Apr 11 16:40:07.478623 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 250/509] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:07 2022] GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a => generated 1507 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:07.589365 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b041397f-6d01-4feb-9b43-a59e6b30cca9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:07.591042 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b041397f-6d01-4feb-9b43-a59e6b30cca9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:07.601311 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b041397f-6d01-4feb-9b43-a59e6b30cca9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:07.601968 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b041397f-6d01-4feb-9b43-a59e6b30cca9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:07.603306 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b041397f-6d01-4feb-9b43-a59e6b30cca9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:07.604133 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b041397f-6d01-4feb-9b43-a59e6b30cca9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:07.813449 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b041397f-6d01-4feb-9b43-a59e6b30cca9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:07.827623 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b041397f-6d01-4feb-9b43-a59e6b30cca9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:07.830661 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b041397f-6d01-4feb-9b43-a59e6b30cca9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:07.832697 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b041397f-6d01-4feb-9b43-a59e6b30cca9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1737 microversion: 2.20 time: 0.252460 Apr 11 16:40:07.835908 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 260/510] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:07 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1737 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:07.983994 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f1f147db-cb84-4bd2-9aae-a5248228d5ed tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:07.985508 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f1f147db-cb84-4bd2-9aae-a5248228d5ed tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:07.998016 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f1f147db-cb84-4bd2-9aae-a5248228d5ed tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:08.000160 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f1f147db-cb84-4bd2-9aae-a5248228d5ed tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:08.004454 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f1f147db-cb84-4bd2-9aae-a5248228d5ed tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:08.011233 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f1f147db-cb84-4bd2-9aae-a5248228d5ed tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:08.323547 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f1f147db-cb84-4bd2-9aae-a5248228d5ed tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:08.342683 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f1f147db-cb84-4bd2-9aae-a5248228d5ed tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1725 microversion: 2.1 time: 0.367071 Apr 11 16:40:08.343694 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 251/511] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:07 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1725 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:08.856611 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-37c95e04-53e3-43a8-9876-786f9baa53af tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:08.859144 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-37c95e04-53e3-43a8-9876-786f9baa53af tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:08.869168 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-37c95e04-53e3-43a8-9876-786f9baa53af tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:08.870494 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-37c95e04-53e3-43a8-9876-786f9baa53af tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:08.872484 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-37c95e04-53e3-43a8-9876-786f9baa53af tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:08.873774 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-37c95e04-53e3-43a8-9876-786f9baa53af tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:09.109244 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-37c95e04-53e3-43a8-9876-786f9baa53af tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:09.118646 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-37c95e04-53e3-43a8-9876-786f9baa53af tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:09.120729 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-37c95e04-53e3-43a8-9876-786f9baa53af tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:09.123648 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-37c95e04-53e3-43a8-9876-786f9baa53af tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1737 microversion: 2.20 time: 0.274595 Apr 11 16:40:09.124562 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 261/512] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:08 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1737 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:09.370751 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-17e5edc6-e56e-43f7-bc80-33efc936c922 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:09.372234 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-17e5edc6-e56e-43f7-bc80-33efc936c922 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:09.380746 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-17e5edc6-e56e-43f7-bc80-33efc936c922 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:09.381230 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-17e5edc6-e56e-43f7-bc80-33efc936c922 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:09.382070 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-17e5edc6-e56e-43f7-bc80-33efc936c922 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:09.382492 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-17e5edc6-e56e-43f7-bc80-33efc936c922 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:09.525797 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-17e5edc6-e56e-43f7-bc80-33efc936c922 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:09.535914 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-17e5edc6-e56e-43f7-bc80-33efc936c922 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1725 microversion: 2.1 time: 0.169054 Apr 11 16:40:09.543092 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 252/513] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:09 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:10.157540 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b41af2b6-45bd-4cd1-8dec-f1f19de54889 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:10.158591 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b41af2b6-45bd-4cd1-8dec-f1f19de54889 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:10.171846 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b41af2b6-45bd-4cd1-8dec-f1f19de54889 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:10.173300 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b41af2b6-45bd-4cd1-8dec-f1f19de54889 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:10.175052 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b41af2b6-45bd-4cd1-8dec-f1f19de54889 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:10.175927 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b41af2b6-45bd-4cd1-8dec-f1f19de54889 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:10.377749 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b41af2b6-45bd-4cd1-8dec-f1f19de54889 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:10.387858 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b41af2b6-45bd-4cd1-8dec-f1f19de54889 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:10.389596 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b41af2b6-45bd-4cd1-8dec-f1f19de54889 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:10.390888 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b41af2b6-45bd-4cd1-8dec-f1f19de54889 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1737 microversion: 2.20 time: 0.240319 Apr 11 16:40:10.391551 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 262/514] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:10 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:10.562222 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-aa5edb6c-5a76-48d5-9d02-3676b5df548b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:10.563984 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-aa5edb6c-5a76-48d5-9d02-3676b5df548b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:10.573983 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-aa5edb6c-5a76-48d5-9d02-3676b5df548b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:10.574847 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-aa5edb6c-5a76-48d5-9d02-3676b5df548b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:10.576088 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-aa5edb6c-5a76-48d5-9d02-3676b5df548b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:10.576818 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-aa5edb6c-5a76-48d5-9d02-3676b5df548b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:10.757663 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-aa5edb6c-5a76-48d5-9d02-3676b5df548b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:10.768342 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-aa5edb6c-5a76-48d5-9d02-3676b5df548b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1725 microversion: 2.1 time: 0.216979 Apr 11 16:40:10.768995 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 253/515] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:10 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:11.410711 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-161c8318-bb57-4815-ad29-a98ca5f88167 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:11.411590 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-161c8318-bb57-4815-ad29-a98ca5f88167 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:11.419628 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-161c8318-bb57-4815-ad29-a98ca5f88167 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:11.420566 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-161c8318-bb57-4815-ad29-a98ca5f88167 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:11.421652 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-161c8318-bb57-4815-ad29-a98ca5f88167 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:11.422359 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-161c8318-bb57-4815-ad29-a98ca5f88167 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:11.613336 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-161c8318-bb57-4815-ad29-a98ca5f88167 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:11.625973 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-161c8318-bb57-4815-ad29-a98ca5f88167 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:11.627854 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-161c8318-bb57-4815-ad29-a98ca5f88167 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:11.629630 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-161c8318-bb57-4815-ad29-a98ca5f88167 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1737 microversion: 2.20 time: 0.223376 Apr 11 16:40:11.630386 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 263/516] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:11 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1737 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:11.786134 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-53971a71-3db6-4ace-a00c-6f8d96f314f4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:11.786855 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-53971a71-3db6-4ace-a00c-6f8d96f314f4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:11.794556 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-53971a71-3db6-4ace-a00c-6f8d96f314f4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:11.795006 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-53971a71-3db6-4ace-a00c-6f8d96f314f4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:11.795818 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-53971a71-3db6-4ace-a00c-6f8d96f314f4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:11.796275 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-53971a71-3db6-4ace-a00c-6f8d96f314f4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:12.060013 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-53971a71-3db6-4ace-a00c-6f8d96f314f4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:12.076625 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-53971a71-3db6-4ace-a00c-6f8d96f314f4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1725 microversion: 2.1 time: 0.293826 Apr 11 16:40:12.078039 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 254/517] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:11 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1725 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:12.655379 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-21df10f6-2e71-43fa-8391-4533e2799e64 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:12.656033 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-21df10f6-2e71-43fa-8391-4533e2799e64 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:12.662419 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-21df10f6-2e71-43fa-8391-4533e2799e64 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:12.663208 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-21df10f6-2e71-43fa-8391-4533e2799e64 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:12.664467 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-21df10f6-2e71-43fa-8391-4533e2799e64 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:12.665078 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-21df10f6-2e71-43fa-8391-4533e2799e64 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:12.892013 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-21df10f6-2e71-43fa-8391-4533e2799e64 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:12.913862 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-21df10f6-2e71-43fa-8391-4533e2799e64 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:12.917651 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-21df10f6-2e71-43fa-8391-4533e2799e64 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:12.920166 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-21df10f6-2e71-43fa-8391-4533e2799e64 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1737 microversion: 2.20 time: 0.268742 Apr 11 16:40:12.924229 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 264/518] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:12 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1737 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:40:13.096032 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a3a7a769-8a87-4c2c-aadb-465bd6e30800 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:13.097475 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a3a7a769-8a87-4c2c-aadb-465bd6e30800 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:13.104517 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a3a7a769-8a87-4c2c-aadb-465bd6e30800 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:13.105055 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a3a7a769-8a87-4c2c-aadb-465bd6e30800 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:13.105925 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a3a7a769-8a87-4c2c-aadb-465bd6e30800 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:13.106367 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a3a7a769-8a87-4c2c-aadb-465bd6e30800 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:13.296340 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a3a7a769-8a87-4c2c-aadb-465bd6e30800 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:13.306902 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a3a7a769-8a87-4c2c-aadb-465bd6e30800 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1725 microversion: 2.1 time: 0.215757 Apr 11 16:40:13.315688 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 255/519] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:13 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:13.959374 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c913414f-fedc-4a80-b2fd-6e3bffdb4c9f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:13.960762 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c913414f-fedc-4a80-b2fd-6e3bffdb4c9f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:13.968704 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c913414f-fedc-4a80-b2fd-6e3bffdb4c9f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:13.969523 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c913414f-fedc-4a80-b2fd-6e3bffdb4c9f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:13.970582 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c913414f-fedc-4a80-b2fd-6e3bffdb4c9f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:13.971248 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c913414f-fedc-4a80-b2fd-6e3bffdb4c9f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:14.153430 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c913414f-fedc-4a80-b2fd-6e3bffdb4c9f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:14.179716 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c913414f-fedc-4a80-b2fd-6e3bffdb4c9f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:14.181729 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c913414f-fedc-4a80-b2fd-6e3bffdb4c9f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:14.183236 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c913414f-fedc-4a80-b2fd-6e3bffdb4c9f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1737 microversion: 2.20 time: 0.234758 Apr 11 16:40:14.192259 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 265/520] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:13 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1737 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:14.328910 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d8475b08-a4ef-4499-a26b-1f75587e4f17 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:14.331285 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d8475b08-a4ef-4499-a26b-1f75587e4f17 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:14.343031 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d8475b08-a4ef-4499-a26b-1f75587e4f17 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:14.344235 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d8475b08-a4ef-4499-a26b-1f75587e4f17 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:14.345921 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d8475b08-a4ef-4499-a26b-1f75587e4f17 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:14.347004 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d8475b08-a4ef-4499-a26b-1f75587e4f17 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:14.578644 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d8475b08-a4ef-4499-a26b-1f75587e4f17 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:14.603322 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d8475b08-a4ef-4499-a26b-1f75587e4f17 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1725 microversion: 2.1 time: 0.279843 Apr 11 16:40:14.604766 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 256/521] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:14 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1725 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:15.211938 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-324b6121-2d1d-4832-8c26-c923f30b66c3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:15.214215 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-324b6121-2d1d-4832-8c26-c923f30b66c3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:15.228062 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-324b6121-2d1d-4832-8c26-c923f30b66c3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:15.228588 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-324b6121-2d1d-4832-8c26-c923f30b66c3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:15.229374 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-324b6121-2d1d-4832-8c26-c923f30b66c3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:15.229823 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-324b6121-2d1d-4832-8c26-c923f30b66c3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:15.452236 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-324b6121-2d1d-4832-8c26-c923f30b66c3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:15.468366 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-324b6121-2d1d-4832-8c26-c923f30b66c3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:15.471452 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-324b6121-2d1d-4832-8c26-c923f30b66c3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:15.473686 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-324b6121-2d1d-4832-8c26-c923f30b66c3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1737 microversion: 2.20 time: 0.269895 Apr 11 16:40:15.474628 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 266/522] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:15 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1737 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:15.637462 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ea83cf30-915e-450e-9fea-35fbfb0923fa tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:15.638456 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ea83cf30-915e-450e-9fea-35fbfb0923fa tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:15.658045 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ea83cf30-915e-450e-9fea-35fbfb0923fa tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:15.658907 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ea83cf30-915e-450e-9fea-35fbfb0923fa tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:15.659723 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ea83cf30-915e-450e-9fea-35fbfb0923fa tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:15.660467 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ea83cf30-915e-450e-9fea-35fbfb0923fa tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:15.933426 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ea83cf30-915e-450e-9fea-35fbfb0923fa tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:15.951171 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ea83cf30-915e-450e-9fea-35fbfb0923fa tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1725 microversion: 2.1 time: 0.322608 Apr 11 16:40:15.963674 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 257/523] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:15 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1725 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:40:16.513435 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3f8a31b1-1d6e-4ffa-9516-d8f188427a6a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:16.515513 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3f8a31b1-1d6e-4ffa-9516-d8f188427a6a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:16.525601 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3f8a31b1-1d6e-4ffa-9516-d8f188427a6a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:16.526945 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3f8a31b1-1d6e-4ffa-9516-d8f188427a6a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:16.528485 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3f8a31b1-1d6e-4ffa-9516-d8f188427a6a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:16.529552 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3f8a31b1-1d6e-4ffa-9516-d8f188427a6a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:16.801547 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3f8a31b1-1d6e-4ffa-9516-d8f188427a6a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:16.818283 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3f8a31b1-1d6e-4ffa-9516-d8f188427a6a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:16.820094 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3f8a31b1-1d6e-4ffa-9516-d8f188427a6a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:16.822281 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3f8a31b1-1d6e-4ffa-9516-d8f188427a6a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1737 microversion: 2.20 time: 0.322579 Apr 11 16:40:16.823795 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 267/524] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:16 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1737 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:16.982499 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a98cbc15-57ba-46e8-986a-0716c1caec91 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:16.983912 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a98cbc15-57ba-46e8-986a-0716c1caec91 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:16.999601 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a98cbc15-57ba-46e8-986a-0716c1caec91 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:17.000619 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a98cbc15-57ba-46e8-986a-0716c1caec91 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:17.004410 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a98cbc15-57ba-46e8-986a-0716c1caec91 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:17.013344 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a98cbc15-57ba-46e8-986a-0716c1caec91 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:17.229356 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a98cbc15-57ba-46e8-986a-0716c1caec91 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:17.238428 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a98cbc15-57ba-46e8-986a-0716c1caec91 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1725 microversion: 2.1 time: 0.263794 Apr 11 16:40:17.238924 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 258/525] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:16 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1725 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:17.854248 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-efffbb9d-c73f-4393-8261-613ce0c69961 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:17.856545 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-efffbb9d-c73f-4393-8261-613ce0c69961 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:17.866397 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-efffbb9d-c73f-4393-8261-613ce0c69961 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:17.867046 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-efffbb9d-c73f-4393-8261-613ce0c69961 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:17.868827 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-efffbb9d-c73f-4393-8261-613ce0c69961 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:17.870049 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-efffbb9d-c73f-4393-8261-613ce0c69961 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:18.147396 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-efffbb9d-c73f-4393-8261-613ce0c69961 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:18.164495 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-efffbb9d-c73f-4393-8261-613ce0c69961 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:18.168085 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-efffbb9d-c73f-4393-8261-613ce0c69961 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:18.170371 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-efffbb9d-c73f-4393-8261-613ce0c69961 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1737 microversion: 2.20 time: 0.322217 Apr 11 16:40:18.171902 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 268/526] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:17 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1737 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:18.265979 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-b17ed14c-8488-430d-8e59-b48bc232c612 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:18.267038 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-b17ed14c-8488-430d-8e59-b48bc232c612 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:18.280412 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b17ed14c-8488-430d-8e59-b48bc232c612 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:18.281922 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b17ed14c-8488-430d-8e59-b48bc232c612 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:18.285827 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b17ed14c-8488-430d-8e59-b48bc232c612 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:18.286573 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b17ed14c-8488-430d-8e59-b48bc232c612 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:18.738588 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-b17ed14c-8488-430d-8e59-b48bc232c612 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:18.750654 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-b17ed14c-8488-430d-8e59-b48bc232c612 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1725 microversion: 2.1 time: 0.497524 Apr 11 16:40:18.751441 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 259/527] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:18 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1725 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:19.190860 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-76464aa0-f2e6-43ee-bd80-e996ec50776a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:19.191776 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-76464aa0-f2e6-43ee-bd80-e996ec50776a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:19.200922 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-76464aa0-f2e6-43ee-bd80-e996ec50776a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:19.202093 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-76464aa0-f2e6-43ee-bd80-e996ec50776a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:19.203870 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-76464aa0-f2e6-43ee-bd80-e996ec50776a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:19.205125 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-76464aa0-f2e6-43ee-bd80-e996ec50776a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:19.495758 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-76464aa0-f2e6-43ee-bd80-e996ec50776a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:19.506165 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-76464aa0-f2e6-43ee-bd80-e996ec50776a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:19.508154 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-76464aa0-f2e6-43ee-bd80-e996ec50776a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:19.509636 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-76464aa0-f2e6-43ee-bd80-e996ec50776a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1737 microversion: 2.20 time: 0.322824 Apr 11 16:40:19.510390 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 269/528] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:19 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1737 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:19.774707 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-b2a61d49-b908-4b47-a2e3-0d0b90f0b6d5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:19.775824 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-b2a61d49-b908-4b47-a2e3-0d0b90f0b6d5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:19.783387 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b2a61d49-b908-4b47-a2e3-0d0b90f0b6d5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:19.784082 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b2a61d49-b908-4b47-a2e3-0d0b90f0b6d5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:19.785000 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b2a61d49-b908-4b47-a2e3-0d0b90f0b6d5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:19.785539 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b2a61d49-b908-4b47-a2e3-0d0b90f0b6d5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:19.939875 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-b2a61d49-b908-4b47-a2e3-0d0b90f0b6d5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:19.949118 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-b2a61d49-b908-4b47-a2e3-0d0b90f0b6d5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1725 microversion: 2.1 time: 0.178272 Apr 11 16:40:19.950506 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 260/529] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:19 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:40:20.532024 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3a70c344-cfe9-4279-ad8e-94af8b945af0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:20.532702 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3a70c344-cfe9-4279-ad8e-94af8b945af0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:20.540811 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3a70c344-cfe9-4279-ad8e-94af8b945af0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:20.541255 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3a70c344-cfe9-4279-ad8e-94af8b945af0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:20.542040 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3a70c344-cfe9-4279-ad8e-94af8b945af0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:20.544036 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3a70c344-cfe9-4279-ad8e-94af8b945af0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:20.720079 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3a70c344-cfe9-4279-ad8e-94af8b945af0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:20.729152 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3a70c344-cfe9-4279-ad8e-94af8b945af0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:20.730716 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3a70c344-cfe9-4279-ad8e-94af8b945af0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:20.732275 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3a70c344-cfe9-4279-ad8e-94af8b945af0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1737 microversion: 2.20 time: 0.205870 Apr 11 16:40:20.732868 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 270/530] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:20 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:20.969928 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-15a08563-0d8a-4187-83fa-572f6997c0b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:20.970546 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-15a08563-0d8a-4187-83fa-572f6997c0b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:20.977691 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-15a08563-0d8a-4187-83fa-572f6997c0b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:20.978132 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-15a08563-0d8a-4187-83fa-572f6997c0b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:20.978915 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-15a08563-0d8a-4187-83fa-572f6997c0b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:20.979319 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-15a08563-0d8a-4187-83fa-572f6997c0b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:21.233728 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-15a08563-0d8a-4187-83fa-572f6997c0b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:21.248770 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-15a08563-0d8a-4187-83fa-572f6997c0b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1725 microversion: 2.1 time: 0.283843 Apr 11 16:40:21.250618 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 261/531] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:20 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1725 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:21.752389 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3a96653a-5bfa-4649-8f8f-06759229f7af tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:21.753154 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3a96653a-5bfa-4649-8f8f-06759229f7af tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:21.760593 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3a96653a-5bfa-4649-8f8f-06759229f7af tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:21.761123 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3a96653a-5bfa-4649-8f8f-06759229f7af tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:21.762039 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3a96653a-5bfa-4649-8f8f-06759229f7af tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:21.762560 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3a96653a-5bfa-4649-8f8f-06759229f7af tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:21.909342 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3a96653a-5bfa-4649-8f8f-06759229f7af tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:21.918528 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3a96653a-5bfa-4649-8f8f-06759229f7af tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:21.920064 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3a96653a-5bfa-4649-8f8f-06759229f7af tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:21.921249 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3a96653a-5bfa-4649-8f8f-06759229f7af tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1719 microversion: 2.20 time: 0.173984 Apr 11 16:40:21.921817 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 271/532] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:21 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:22.276811 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a577bb34-a6e2-4767-a314-ca475f85be2e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:22.277636 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a577bb34-a6e2-4767-a314-ca475f85be2e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:22.284987 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a577bb34-a6e2-4767-a314-ca475f85be2e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:22.285396 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a577bb34-a6e2-4767-a314-ca475f85be2e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:22.286216 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a577bb34-a6e2-4767-a314-ca475f85be2e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:22.286687 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a577bb34-a6e2-4767-a314-ca475f85be2e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:22.430009 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a577bb34-a6e2-4767-a314-ca475f85be2e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:22.440105 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a577bb34-a6e2-4767-a314-ca475f85be2e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1725 microversion: 2.1 time: 0.167047 Apr 11 16:40:22.440862 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 262/533] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:22 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:22.941238 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-772be235-526e-4809-b6ba-e6cbbd768fbb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:22.942040 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-772be235-526e-4809-b6ba-e6cbbd768fbb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:22.950194 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-772be235-526e-4809-b6ba-e6cbbd768fbb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:22.950913 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-772be235-526e-4809-b6ba-e6cbbd768fbb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:22.951886 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-772be235-526e-4809-b6ba-e6cbbd768fbb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:22.952411 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-772be235-526e-4809-b6ba-e6cbbd768fbb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:23.125873 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-772be235-526e-4809-b6ba-e6cbbd768fbb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:23.134864 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-772be235-526e-4809-b6ba-e6cbbd768fbb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:23.136409 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-772be235-526e-4809-b6ba-e6cbbd768fbb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:23.137733 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-772be235-526e-4809-b6ba-e6cbbd768fbb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1719 microversion: 2.20 time: 0.200897 Apr 11 16:40:23.138296 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 272/534] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:22 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1719 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:23.459291 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-df51bf22-7d54-4638-9e2b-3294815d9dbd tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:23.459985 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-df51bf22-7d54-4638-9e2b-3294815d9dbd tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:23.467193 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-df51bf22-7d54-4638-9e2b-3294815d9dbd tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:23.467693 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-df51bf22-7d54-4638-9e2b-3294815d9dbd tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:23.468545 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-df51bf22-7d54-4638-9e2b-3294815d9dbd tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:23.469019 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-df51bf22-7d54-4638-9e2b-3294815d9dbd tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:23.615398 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-df51bf22-7d54-4638-9e2b-3294815d9dbd tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:23.629295 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-df51bf22-7d54-4638-9e2b-3294815d9dbd tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1725 microversion: 2.1 time: 0.173682 Apr 11 16:40:23.630236 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 263/535] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:23 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:24.158814 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ae1200d6-c238-488d-b3ef-8b6099ae4a40 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:24.159423 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ae1200d6-c238-488d-b3ef-8b6099ae4a40 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:24.169255 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ae1200d6-c238-488d-b3ef-8b6099ae4a40 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:24.170019 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ae1200d6-c238-488d-b3ef-8b6099ae4a40 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:24.171389 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ae1200d6-c238-488d-b3ef-8b6099ae4a40 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:24.172182 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ae1200d6-c238-488d-b3ef-8b6099ae4a40 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:24.313010 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-d8f9a524-5678-440a-9078-4fccc547089b req-960af4f0-af5a-4a57-ac9c-3d14906be94f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08685e5-3c41-4032-9633-cc591711221a", "name": "network-vif-unplugged", "status": "completed", "tag": "8b85453b-0363-47d5-9902-93d848d7263e"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:40:24.327857 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-d8f9a524-5678-440a-9078-4fccc547089b req-960af4f0-af5a-4a57-ac9c-3d14906be94f service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:24.328657 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-d8f9a524-5678-440a-9078-4fccc547089b req-960af4f0-af5a-4a57-ac9c-3d14906be94f service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:24.357315 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.compute.server_external_events [req-d8f9a524-5678-440a-9078-4fccc547089b req-960af4f0-af5a-4a57-ac9c-3d14906be94f service nova] Unable to find a host for instance f08685e5-3c41-4032-9633-cc591711221a. Dropping event network-vif-unplugged {{(pid=123774) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 11 16:40:24.358800 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-d8f9a524-5678-440a-9078-4fccc547089b req-960af4f0-af5a-4a57-ac9c-3d14906be94f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.051639 Apr 11 16:40:24.359807 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 264/536] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 53 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 11 16:40:24.377367 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ae1200d6-c238-488d-b3ef-8b6099ae4a40 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:24.389768 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ae1200d6-c238-488d-b3ef-8b6099ae4a40 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:24.392172 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ae1200d6-c238-488d-b3ef-8b6099ae4a40 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:24.394134 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ae1200d6-c238-488d-b3ef-8b6099ae4a40 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1662 microversion: 2.20 time: 0.239414 Apr 11 16:40:24.395575 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 273/537] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:24 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1662 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:24.423342 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-7220a66f-a2f2-42cc-890d-38c5dd9cd0c1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8700b053-f73e-4d5a-ad7a-5cae9c23f612"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:40:24.424531 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-7220a66f-a2f2-42cc-890d-38c5dd9cd0c1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:24.431113 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7220a66f-a2f2-42cc-890d-38c5dd9cd0c1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:24.431553 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7220a66f-a2f2-42cc-890d-38c5dd9cd0c1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:24.432356 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7220a66f-a2f2-42cc-890d-38c5dd9cd0c1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:24.432781 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7220a66f-a2f2-42cc-890d-38c5dd9cd0c1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:24.654863 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-4f3f7d0e-79b8-4637-b8d1-f13bf1bf95b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:24.655775 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-4f3f7d0e-79b8-4637-b8d1-f13bf1bf95b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:24.663211 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4f3f7d0e-79b8-4637-b8d1-f13bf1bf95b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:24.663902 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4f3f7d0e-79b8-4637-b8d1-f13bf1bf95b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:24.664866 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4f3f7d0e-79b8-4637-b8d1-f13bf1bf95b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:24.665434 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4f3f7d0e-79b8-4637-b8d1-f13bf1bf95b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:24.775737 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-7220a66f-a2f2-42cc-890d-38c5dd9cd0c1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "POST /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.357239 Apr 11 16:40:24.776848 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 265/538] 10.222.0.65 () {62 vars in 1363 bytes} [Mon Apr 11 16:40:24 2022] POST /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a/os-volume_attachments => generated 188 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 16:40:24.849761 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-4f3f7d0e-79b8-4637-b8d1-f13bf1bf95b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:24.860119 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-4f3f7d0e-79b8-4637-b8d1-f13bf1bf95b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1702 microversion: 2.1 time: 0.211007 Apr 11 16:40:24.860805 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 274/539] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:24 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1702 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:40:24.890939 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-1ebd0e28-b0a2-4291-ba8d-2ffad78d5b12 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:40:24.901809 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1ebd0e28-b0a2-4291-ba8d-2ffad78d5b12 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:24.902572 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1ebd0e28-b0a2-4291-ba8d-2ffad78d5b12 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:24.964299 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f08540cc-fb15-48b6-8ecb-152532ef7632 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:40:24.965272 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f08540cc-fb15-48b6-8ecb-152532ef7632 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:24.975690 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f08540cc-fb15-48b6-8ecb-152532ef7632 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:24.976443 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f08540cc-fb15-48b6-8ecb-152532ef7632 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:24.977806 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f08540cc-fb15-48b6-8ecb-152532ef7632 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:24.978567 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f08540cc-fb15-48b6-8ecb-152532ef7632 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:24.986667 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-1ebd0e28-b0a2-4291-ba8d-2ffad78d5b12 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Going to try to start instance {{(pid=123774) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 11 16:40:25.037943 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-1ebd0e28-b0a2-4291-ba8d-2ffad78d5b12 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "POST /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768/action" status: 202 len: 0 microversion: 2.1 time: 0.152995 Apr 11 16:40:25.041930 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 266/540] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Apr 11 16:40:24 2022] POST /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:40:25.049481 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d8c9904b-bd2e-48be-9322-4dbb5eb18873 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:25.050471 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d8c9904b-bd2e-48be-9322-4dbb5eb18873 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:25.058544 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d8c9904b-bd2e-48be-9322-4dbb5eb18873 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:25.059464 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d8c9904b-bd2e-48be-9322-4dbb5eb18873 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:25.060441 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d8c9904b-bd2e-48be-9322-4dbb5eb18873 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:25.060900 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d8c9904b-bd2e-48be-9322-4dbb5eb18873 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:25.165003 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f08540cc-fb15-48b6-8ecb-152532ef7632 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "POST /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a/action" status: 202 len: 0 microversion: 2.20 time: 0.206863 Apr 11 16:40:25.168184 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 275/541] 10.222.0.65 () {62 vars in 1318 bytes} [Mon Apr 11 16:40:24 2022] POST /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 11 16:40:25.182852 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-7532f5ac-5a8e-4340-93b0-3c326b072624 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:25.184988 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-7532f5ac-5a8e-4340-93b0-3c326b072624 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:25.198362 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7532f5ac-5a8e-4340-93b0-3c326b072624 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:25.199309 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7532f5ac-5a8e-4340-93b0-3c326b072624 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:25.201185 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7532f5ac-5a8e-4340-93b0-3c326b072624 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:25.201896 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7532f5ac-5a8e-4340-93b0-3c326b072624 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:25.700100 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d8c9904b-bd2e-48be-9322-4dbb5eb18873 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:25.714681 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d8c9904b-bd2e-48be-9322-4dbb5eb18873 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1711 microversion: 2.1 time: 0.669181 Apr 11 16:40:25.716148 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 267/542] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:25 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1711 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:25.799777 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-7532f5ac-5a8e-4340-93b0-3c326b072624 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:25.815912 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-7532f5ac-5a8e-4340-93b0-3c326b072624 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:25.818394 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-7532f5ac-5a8e-4340-93b0-3c326b072624 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:25.820574 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-7532f5ac-5a8e-4340-93b0-3c326b072624 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1748 microversion: 2.20 time: 0.646331 Apr 11 16:40:25.821657 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 276/543] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:25 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1748 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:26.734734 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-3c335cd6-a187-49a3-a4fb-6b0b3445935a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:26.735781 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-3c335cd6-a187-49a3-a4fb-6b0b3445935a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:26.744363 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3c335cd6-a187-49a3-a4fb-6b0b3445935a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:26.744956 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3c335cd6-a187-49a3-a4fb-6b0b3445935a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:26.745893 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3c335cd6-a187-49a3-a4fb-6b0b3445935a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:26.746473 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3c335cd6-a187-49a3-a4fb-6b0b3445935a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:26.845320 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b20bd0db-1801-44ca-8946-88d078ff4ae9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:26.846114 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b20bd0db-1801-44ca-8946-88d078ff4ae9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:26.854366 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b20bd0db-1801-44ca-8946-88d078ff4ae9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:26.854808 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b20bd0db-1801-44ca-8946-88d078ff4ae9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:26.855911 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b20bd0db-1801-44ca-8946-88d078ff4ae9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:26.856364 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b20bd0db-1801-44ca-8946-88d078ff4ae9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:26.950976 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-3c335cd6-a187-49a3-a4fb-6b0b3445935a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:26.960107 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-3c335cd6-a187-49a3-a4fb-6b0b3445935a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1711 microversion: 2.1 time: 0.230596 Apr 11 16:40:26.960682 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 268/544] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:26 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1711 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:27.023574 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b20bd0db-1801-44ca-8946-88d078ff4ae9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:27.033070 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b20bd0db-1801-44ca-8946-88d078ff4ae9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:27.034584 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b20bd0db-1801-44ca-8946-88d078ff4ae9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:27.035767 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b20bd0db-1801-44ca-8946-88d078ff4ae9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1750 microversion: 2.20 time: 0.196736 Apr 11 16:40:27.036320 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 277/545] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:26 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1750 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:40:27.978769 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-8cdc3068-2690-4af8-b264-2cad840097cc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:27.979474 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-8cdc3068-2690-4af8-b264-2cad840097cc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:27.989921 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8cdc3068-2690-4af8-b264-2cad840097cc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:27.990605 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8cdc3068-2690-4af8-b264-2cad840097cc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:27.991939 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8cdc3068-2690-4af8-b264-2cad840097cc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:27.992608 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8cdc3068-2690-4af8-b264-2cad840097cc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:28.055165 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-9c8945dd-4c1b-45f6-bbc7-6f9b155f73d0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:28.056099 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-9c8945dd-4c1b-45f6-bbc7-6f9b155f73d0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:28.063708 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9c8945dd-4c1b-45f6-bbc7-6f9b155f73d0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:28.064320 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9c8945dd-4c1b-45f6-bbc7-6f9b155f73d0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:28.065256 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9c8945dd-4c1b-45f6-bbc7-6f9b155f73d0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:28.065758 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9c8945dd-4c1b-45f6-bbc7-6f9b155f73d0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:28.202167 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8cdc3068-2690-4af8-b264-2cad840097cc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:28.217609 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-8cdc3068-2690-4af8-b264-2cad840097cc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1715 microversion: 2.1 time: 0.242577 Apr 11 16:40:28.218605 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 269/546] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:40:27 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1715 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:40:28.313155 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9c8945dd-4c1b-45f6-bbc7-6f9b155f73d0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:28.322972 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9c8945dd-4c1b-45f6-bbc7-6f9b155f73d0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:28.324549 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9c8945dd-4c1b-45f6-bbc7-6f9b155f73d0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:28.325721 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-9c8945dd-4c1b-45f6-bbc7-6f9b155f73d0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.274716 Apr 11 16:40:28.326286 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 278/547] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:28 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:29.356036 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-71c4cb7f-144e-4bed-8cf0-b808e5988aad tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:29.359260 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-71c4cb7f-144e-4bed-8cf0-b808e5988aad tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:29.371193 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-71c4cb7f-144e-4bed-8cf0-b808e5988aad tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:29.372557 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-71c4cb7f-144e-4bed-8cf0-b808e5988aad tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:29.377758 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-71c4cb7f-144e-4bed-8cf0-b808e5988aad tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:29.379121 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-71c4cb7f-144e-4bed-8cf0-b808e5988aad tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:29.599562 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-71c4cb7f-144e-4bed-8cf0-b808e5988aad tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:29.614601 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-71c4cb7f-144e-4bed-8cf0-b808e5988aad tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:29.617805 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-71c4cb7f-144e-4bed-8cf0-b808e5988aad tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:29.620043 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-71c4cb7f-144e-4bed-8cf0-b808e5988aad tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.272888 Apr 11 16:40:29.621105 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 270/548] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:29 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:30.655856 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-6a0874d7-4f6d-41bd-bb13-6a9ef57e4b36 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:30.657716 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-6a0874d7-4f6d-41bd-bb13-6a9ef57e4b36 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:30.668850 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6a0874d7-4f6d-41bd-bb13-6a9ef57e4b36 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:30.669607 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6a0874d7-4f6d-41bd-bb13-6a9ef57e4b36 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:30.671062 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6a0874d7-4f6d-41bd-bb13-6a9ef57e4b36 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:30.671874 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6a0874d7-4f6d-41bd-bb13-6a9ef57e4b36 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:30.885635 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6a0874d7-4f6d-41bd-bb13-6a9ef57e4b36 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:30.899363 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6a0874d7-4f6d-41bd-bb13-6a9ef57e4b36 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:30.901239 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6a0874d7-4f6d-41bd-bb13-6a9ef57e4b36 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:30.903274 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-6a0874d7-4f6d-41bd-bb13-6a9ef57e4b36 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.253727 Apr 11 16:40:30.904137 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 279/549] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:30 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:31.894070 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c81d9c1b-885c-4625-b7be-c9b45327ec38 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ddcd8bc-d9cd-49c0-87cd-04d89476d1af", "device": "/dev/sdb"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:40:31.895760 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c81d9c1b-885c-4625-b7be-c9b45327ec38 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:31.909604 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c81d9c1b-885c-4625-b7be-c9b45327ec38 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:31.910521 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c81d9c1b-885c-4625-b7be-c9b45327ec38 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:31.912493 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c81d9c1b-885c-4625-b7be-c9b45327ec38 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:31.913624 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c81d9c1b-885c-4625-b7be-c9b45327ec38 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:31.927212 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f9a041e1-8983-412d-99d8-ef5c5d1acd1f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:31.929177 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f9a041e1-8983-412d-99d8-ef5c5d1acd1f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:31.940001 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f9a041e1-8983-412d-99d8-ef5c5d1acd1f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:31.940587 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f9a041e1-8983-412d-99d8-ef5c5d1acd1f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:31.941470 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f9a041e1-8983-412d-99d8-ef5c5d1acd1f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:31.942009 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f9a041e1-8983-412d-99d8-ef5c5d1acd1f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:32.184398 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f9a041e1-8983-412d-99d8-ef5c5d1acd1f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:32.201412 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f9a041e1-8983-412d-99d8-ef5c5d1acd1f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:32.203284 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f9a041e1-8983-412d-99d8-ef5c5d1acd1f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:32.205312 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f9a041e1-8983-412d-99d8-ef5c5d1acd1f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.285259 Apr 11 16:40:32.206095 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 280/550] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:31 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:40:33.359578 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-191281b5-191c-4b06-a783-d95e4e4882c8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:33.360407 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-191281b5-191c-4b06-a783-d95e4e4882c8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:33.367465 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-191281b5-191c-4b06-a783-d95e4e4882c8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:33.367974 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-191281b5-191c-4b06-a783-d95e4e4882c8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:33.368852 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-191281b5-191c-4b06-a783-d95e4e4882c8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:33.369305 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-191281b5-191c-4b06-a783-d95e4e4882c8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:33.535747 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-191281b5-191c-4b06-a783-d95e4e4882c8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:33.549941 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-191281b5-191c-4b06-a783-d95e4e4882c8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:33.551599 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-191281b5-191c-4b06-a783-d95e4e4882c8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:33.552816 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-191281b5-191c-4b06-a783-d95e4e4882c8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.327653 Apr 11 16:40:33.553389 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 281/551] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:33 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:40:34.576392 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-07868df0-3330-438e-95a4-6c286119df71 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:34.577413 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-07868df0-3330-438e-95a4-6c286119df71 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:34.585524 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-07868df0-3330-438e-95a4-6c286119df71 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:34.586297 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-07868df0-3330-438e-95a4-6c286119df71 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:34.587175 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-07868df0-3330-438e-95a4-6c286119df71 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:34.587728 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-07868df0-3330-438e-95a4-6c286119df71 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:34.767878 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-07868df0-3330-438e-95a4-6c286119df71 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:34.780572 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-07868df0-3330-438e-95a4-6c286119df71 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:34.782248 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-07868df0-3330-438e-95a4-6c286119df71 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:34.783621 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-07868df0-3330-438e-95a4-6c286119df71 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.215493 Apr 11 16:40:34.784270 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 282/552] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:34 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:40:35.806169 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-30d45adf-a759-4c57-905f-a1d5c0f497b2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:35.807323 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-30d45adf-a759-4c57-905f-a1d5c0f497b2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:35.818296 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-30d45adf-a759-4c57-905f-a1d5c0f497b2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:35.818977 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-30d45adf-a759-4c57-905f-a1d5c0f497b2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:35.820207 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-30d45adf-a759-4c57-905f-a1d5c0f497b2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:35.820862 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-30d45adf-a759-4c57-905f-a1d5c0f497b2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:36.021315 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-30d45adf-a759-4c57-905f-a1d5c0f497b2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:36.030841 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-30d45adf-a759-4c57-905f-a1d5c0f497b2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:36.032387 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-30d45adf-a759-4c57-905f-a1d5c0f497b2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:36.033613 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-30d45adf-a759-4c57-905f-a1d5c0f497b2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.234634 Apr 11 16:40:36.034658 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 283/553] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:35 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:37.053155 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-4cce19f1-6a88-4646-92d7-050d95625057 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:37.054074 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-4cce19f1-6a88-4646-92d7-050d95625057 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:37.062013 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4cce19f1-6a88-4646-92d7-050d95625057 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:37.062463 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4cce19f1-6a88-4646-92d7-050d95625057 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:37.063269 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4cce19f1-6a88-4646-92d7-050d95625057 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:37.063722 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4cce19f1-6a88-4646-92d7-050d95625057 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:37.272888 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-4cce19f1-6a88-4646-92d7-050d95625057 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:37.282462 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-4cce19f1-6a88-4646-92d7-050d95625057 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:37.284048 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-4cce19f1-6a88-4646-92d7-050d95625057 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:37.285288 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-4cce19f1-6a88-4646-92d7-050d95625057 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.236290 Apr 11 16:40:37.288115 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 284/554] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:37 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:40:38.307011 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d7d25f94-9ca3-450a-bb06-5ad05706838e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:38.308268 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d7d25f94-9ca3-450a-bb06-5ad05706838e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:38.316058 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d7d25f94-9ca3-450a-bb06-5ad05706838e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:38.316757 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d7d25f94-9ca3-450a-bb06-5ad05706838e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:38.317860 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d7d25f94-9ca3-450a-bb06-5ad05706838e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:38.318544 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d7d25f94-9ca3-450a-bb06-5ad05706838e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:38.500197 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d7d25f94-9ca3-450a-bb06-5ad05706838e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:38.527099 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d7d25f94-9ca3-450a-bb06-5ad05706838e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:38.528954 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d7d25f94-9ca3-450a-bb06-5ad05706838e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:38.530395 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d7d25f94-9ca3-450a-bb06-5ad05706838e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.230210 Apr 11 16:40:38.531155 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 285/555] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:38 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:39.554546 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-43fd2851-bf69-4c05-93d5-b99fec33f929 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:39.555347 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-43fd2851-bf69-4c05-93d5-b99fec33f929 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:39.563336 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-43fd2851-bf69-4c05-93d5-b99fec33f929 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:39.563801 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-43fd2851-bf69-4c05-93d5-b99fec33f929 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:39.564580 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-43fd2851-bf69-4c05-93d5-b99fec33f929 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:39.565002 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-43fd2851-bf69-4c05-93d5-b99fec33f929 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:39.715903 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-43fd2851-bf69-4c05-93d5-b99fec33f929 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:39.733881 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-43fd2851-bf69-4c05-93d5-b99fec33f929 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:39.735541 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-43fd2851-bf69-4c05-93d5-b99fec33f929 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:39.736816 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-43fd2851-bf69-4c05-93d5-b99fec33f929 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.189166 Apr 11 16:40:39.737399 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 286/556] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:39 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:40.757793 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d56cf032-d605-484d-847f-28e24c8db48a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:40.758950 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d56cf032-d605-484d-847f-28e24c8db48a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:40.769944 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d56cf032-d605-484d-847f-28e24c8db48a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:40.770638 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d56cf032-d605-484d-847f-28e24c8db48a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:40.772063 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d56cf032-d605-484d-847f-28e24c8db48a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:40.772815 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d56cf032-d605-484d-847f-28e24c8db48a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:40.962200 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d56cf032-d605-484d-847f-28e24c8db48a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:40.972586 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d56cf032-d605-484d-847f-28e24c8db48a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:40.974127 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d56cf032-d605-484d-847f-28e24c8db48a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:40.975359 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d56cf032-d605-484d-847f-28e24c8db48a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.222237 Apr 11 16:40:40.975981 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 287/557] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:40 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:40:41.994368 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-9d071e76-e2c7-414e-92cf-2bbe9e283c59 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:41.996014 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-9d071e76-e2c7-414e-92cf-2bbe9e283c59 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:42.002988 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9d071e76-e2c7-414e-92cf-2bbe9e283c59 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:42.003575 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9d071e76-e2c7-414e-92cf-2bbe9e283c59 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:42.004403 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9d071e76-e2c7-414e-92cf-2bbe9e283c59 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:42.005000 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9d071e76-e2c7-414e-92cf-2bbe9e283c59 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:42.170290 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9d071e76-e2c7-414e-92cf-2bbe9e283c59 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:42.179834 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9d071e76-e2c7-414e-92cf-2bbe9e283c59 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:42.181340 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9d071e76-e2c7-414e-92cf-2bbe9e283c59 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:42.182585 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-9d071e76-e2c7-414e-92cf-2bbe9e283c59 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.192341 Apr 11 16:40:42.183557 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 288/558] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:41 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:43.203674 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-34950e2a-d8a6-4817-a03f-5612048cc407 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:43.204487 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-34950e2a-d8a6-4817-a03f-5612048cc407 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:43.211394 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-34950e2a-d8a6-4817-a03f-5612048cc407 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:43.211946 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-34950e2a-d8a6-4817-a03f-5612048cc407 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:43.212785 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-34950e2a-d8a6-4817-a03f-5612048cc407 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:43.213264 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-34950e2a-d8a6-4817-a03f-5612048cc407 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:43.385205 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-34950e2a-d8a6-4817-a03f-5612048cc407 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:43.395473 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-34950e2a-d8a6-4817-a03f-5612048cc407 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:43.397093 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-34950e2a-d8a6-4817-a03f-5612048cc407 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:43.398340 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-34950e2a-d8a6-4817-a03f-5612048cc407 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.199588 Apr 11 16:40:43.398908 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 289/559] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:43 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:40:44.418266 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-45436660-685b-4444-bede-43161546c6aa tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:44.419279 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-45436660-685b-4444-bede-43161546c6aa tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:44.426346 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-45436660-685b-4444-bede-43161546c6aa tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:44.426781 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-45436660-685b-4444-bede-43161546c6aa tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:44.427555 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-45436660-685b-4444-bede-43161546c6aa tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:44.428030 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-45436660-685b-4444-bede-43161546c6aa tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:44.575937 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-45436660-685b-4444-bede-43161546c6aa tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:44.585354 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-45436660-685b-4444-bede-43161546c6aa tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:44.587098 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-45436660-685b-4444-bede-43161546c6aa tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:44.588373 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-45436660-685b-4444-bede-43161546c6aa tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.174896 Apr 11 16:40:44.589224 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 290/560] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:44 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:40:45.608289 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-a5f21351-8674-4952-9d6f-a73df6908b99 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:45.609262 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-a5f21351-8674-4952-9d6f-a73df6908b99 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:45.615935 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a5f21351-8674-4952-9d6f-a73df6908b99 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:45.616655 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a5f21351-8674-4952-9d6f-a73df6908b99 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:45.617623 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a5f21351-8674-4952-9d6f-a73df6908b99 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:45.618037 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a5f21351-8674-4952-9d6f-a73df6908b99 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:45.661710 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c81d9c1b-885c-4625-b7be-c9b45327ec38 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "POST /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 13.771041 Apr 11 16:40:45.663162 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 271/561] 10.222.0.65 () {60 vars in 1322 bytes} [Mon Apr 11 16:40:31 2022] POST /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a/os-volume_attachments => generated 194 bytes in 13774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:40:45.901937 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-a5f21351-8674-4952-9d6f-a73df6908b99 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:45.915224 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-a5f21351-8674-4952-9d6f-a73df6908b99 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:45.917382 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-a5f21351-8674-4952-9d6f-a73df6908b99 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:45.919053 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-a5f21351-8674-4952-9d6f-a73df6908b99 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.315794 Apr 11 16:40:45.919768 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 291/562] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:45 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:46.938719 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-3d6884b3-49d9-4964-9d88-d831fb3508a4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:46.940051 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-3d6884b3-49d9-4964-9d88-d831fb3508a4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:46.946657 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3d6884b3-49d9-4964-9d88-d831fb3508a4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:46.946903 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3d6884b3-49d9-4964-9d88-d831fb3508a4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:46.947518 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3d6884b3-49d9-4964-9d88-d831fb3508a4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:46.948067 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3d6884b3-49d9-4964-9d88-d831fb3508a4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:47.080500 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-3d6884b3-49d9-4964-9d88-d831fb3508a4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:47.089500 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-3d6884b3-49d9-4964-9d88-d831fb3508a4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:47.090996 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-3d6884b3-49d9-4964-9d88-d831fb3508a4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:47.092201 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-3d6884b3-49d9-4964-9d88-d831fb3508a4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.158495 Apr 11 16:40:47.092785 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 272/563] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:46 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:48.115916 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-a64752e2-2b2d-4531-87c9-61749bf7a0e6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:48.116504 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-a64752e2-2b2d-4531-87c9-61749bf7a0e6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:48.124502 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a64752e2-2b2d-4531-87c9-61749bf7a0e6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:48.124943 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a64752e2-2b2d-4531-87c9-61749bf7a0e6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:48.125736 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a64752e2-2b2d-4531-87c9-61749bf7a0e6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:48.126148 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a64752e2-2b2d-4531-87c9-61749bf7a0e6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:48.271507 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-a64752e2-2b2d-4531-87c9-61749bf7a0e6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:48.280720 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-a64752e2-2b2d-4531-87c9-61749bf7a0e6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:48.282214 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-a64752e2-2b2d-4531-87c9-61749bf7a0e6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:48.283382 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-a64752e2-2b2d-4531-87c9-61749bf7a0e6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.173455 Apr 11 16:40:48.283991 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 292/564] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:48 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:48.493676 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-31387d48-be9c-4b68-ba51-a2a6d975a082 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c6b71eb-3344-4a0e-8bb2-98e196d4b5ed"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:40:48.494876 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-31387d48-be9c-4b68-ba51-a2a6d975a082 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:48.501969 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-31387d48-be9c-4b68-ba51-a2a6d975a082 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:48.502411 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-31387d48-be9c-4b68-ba51-a2a6d975a082 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:48.503187 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-31387d48-be9c-4b68-ba51-a2a6d975a082 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:48.503614 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-31387d48-be9c-4b68-ba51-a2a6d975a082 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:48.788598 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-31387d48-be9c-4b68-ba51-a2a6d975a082 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "POST /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.422256 Apr 11 16:40:48.789590 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 273/565] 10.222.0.65 () {60 vars in 1322 bytes} [Mon Apr 11 16:40:48 2022] POST /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:40:49.303078 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-5561c4e1-e526-4c4b-b6ef-99a22026a737 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:49.303716 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-5561c4e1-e526-4c4b-b6ef-99a22026a737 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:49.311814 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5561c4e1-e526-4c4b-b6ef-99a22026a737 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:49.312441 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5561c4e1-e526-4c4b-b6ef-99a22026a737 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:49.313430 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5561c4e1-e526-4c4b-b6ef-99a22026a737 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:49.313860 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5561c4e1-e526-4c4b-b6ef-99a22026a737 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:49.457147 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5561c4e1-e526-4c4b-b6ef-99a22026a737 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:49.466730 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5561c4e1-e526-4c4b-b6ef-99a22026a737 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:49.468250 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5561c4e1-e526-4c4b-b6ef-99a22026a737 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:49.469437 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-5561c4e1-e526-4c4b-b6ef-99a22026a737 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.170892 Apr 11 16:40:49.470013 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 293/566] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:49 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:50.495683 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c75534b9-c10b-468c-ab96-33a6c3d5b34b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:50.496455 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c75534b9-c10b-468c-ab96-33a6c3d5b34b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:50.503996 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c75534b9-c10b-468c-ab96-33a6c3d5b34b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:50.504441 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c75534b9-c10b-468c-ab96-33a6c3d5b34b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:50.505251 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c75534b9-c10b-468c-ab96-33a6c3d5b34b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:50.505686 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c75534b9-c10b-468c-ab96-33a6c3d5b34b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:50.651232 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c75534b9-c10b-468c-ab96-33a6c3d5b34b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:50.660295 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c75534b9-c10b-468c-ab96-33a6c3d5b34b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:50.661760 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c75534b9-c10b-468c-ab96-33a6c3d5b34b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:50.662976 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c75534b9-c10b-468c-ab96-33a6c3d5b34b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.172689 Apr 11 16:40:50.663511 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 274/567] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:50 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:51.682913 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-fc09288d-4c19-4394-b19e-9a6247d54567 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:51.683913 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-fc09288d-4c19-4394-b19e-9a6247d54567 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:51.690845 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fc09288d-4c19-4394-b19e-9a6247d54567 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:51.691290 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fc09288d-4c19-4394-b19e-9a6247d54567 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:51.692108 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fc09288d-4c19-4394-b19e-9a6247d54567 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:51.692533 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fc09288d-4c19-4394-b19e-9a6247d54567 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:51.846044 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-fc09288d-4c19-4394-b19e-9a6247d54567 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:51.860873 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-fc09288d-4c19-4394-b19e-9a6247d54567 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:51.864270 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-fc09288d-4c19-4394-b19e-9a6247d54567 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:51.866648 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-fc09288d-4c19-4394-b19e-9a6247d54567 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.187473 Apr 11 16:40:51.867302 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 294/568] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:51 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:52.887017 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-03209160-f612-4a83-ac3b-11055beb5e46 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:52.888363 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-03209160-f612-4a83-ac3b-11055beb5e46 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:52.897631 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-03209160-f612-4a83-ac3b-11055beb5e46 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:52.898382 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-03209160-f612-4a83-ac3b-11055beb5e46 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:52.899758 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-03209160-f612-4a83-ac3b-11055beb5e46 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:52.900497 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-03209160-f612-4a83-ac3b-11055beb5e46 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:53.077003 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-03209160-f612-4a83-ac3b-11055beb5e46 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:53.086277 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-03209160-f612-4a83-ac3b-11055beb5e46 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:53.087879 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-03209160-f612-4a83-ac3b-11055beb5e46 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:53.089352 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-03209160-f612-4a83-ac3b-11055beb5e46 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.207029 Apr 11 16:40:53.090775 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 275/569] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:52 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:54.108583 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d90f775d-d8ce-4368-b17d-025490549343 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:54.109240 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d90f775d-d8ce-4368-b17d-025490549343 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:54.115664 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d90f775d-d8ce-4368-b17d-025490549343 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:54.116148 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d90f775d-d8ce-4368-b17d-025490549343 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:54.116891 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d90f775d-d8ce-4368-b17d-025490549343 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:54.117322 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d90f775d-d8ce-4368-b17d-025490549343 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:54.302297 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d90f775d-d8ce-4368-b17d-025490549343 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:54.313636 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d90f775d-d8ce-4368-b17d-025490549343 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:54.316642 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d90f775d-d8ce-4368-b17d-025490549343 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:54.318741 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d90f775d-d8ce-4368-b17d-025490549343 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.214589 Apr 11 16:40:54.319470 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 295/570] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:54 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:55.345387 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-61c1a2dc-d6b1-48d0-b107-657a9ea9d86c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:55.346187 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-61c1a2dc-d6b1-48d0-b107-657a9ea9d86c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:55.353024 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-61c1a2dc-d6b1-48d0-b107-657a9ea9d86c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:55.353466 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-61c1a2dc-d6b1-48d0-b107-657a9ea9d86c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:55.354258 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-61c1a2dc-d6b1-48d0-b107-657a9ea9d86c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:55.354675 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-61c1a2dc-d6b1-48d0-b107-657a9ea9d86c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:55.501432 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-61c1a2dc-d6b1-48d0-b107-657a9ea9d86c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:55.510865 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-61c1a2dc-d6b1-48d0-b107-657a9ea9d86c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:55.512392 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-61c1a2dc-d6b1-48d0-b107-657a9ea9d86c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:55.513571 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-61c1a2dc-d6b1-48d0-b107-657a9ea9d86c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.172435 Apr 11 16:40:55.514146 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 276/571] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:55 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:56.542417 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-6a71a458-2591-4d72-91d2-1efdc0d27c72 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:56.543273 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-6a71a458-2591-4d72-91d2-1efdc0d27c72 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:56.550098 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6a71a458-2591-4d72-91d2-1efdc0d27c72 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:56.550544 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6a71a458-2591-4d72-91d2-1efdc0d27c72 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:56.551303 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6a71a458-2591-4d72-91d2-1efdc0d27c72 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:56.551760 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6a71a458-2591-4d72-91d2-1efdc0d27c72 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:56.703179 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6a71a458-2591-4d72-91d2-1efdc0d27c72 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:56.716571 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6a71a458-2591-4d72-91d2-1efdc0d27c72 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:56.718117 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6a71a458-2591-4d72-91d2-1efdc0d27c72 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:56.719289 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-6a71a458-2591-4d72-91d2-1efdc0d27c72 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.181613 Apr 11 16:40:56.720012 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 296/572] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:56 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:57.740612 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a77ea970-1343-41be-9386-178063c8c094 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:57.741552 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a77ea970-1343-41be-9386-178063c8c094 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:57.749088 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a77ea970-1343-41be-9386-178063c8c094 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:57.749668 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a77ea970-1343-41be-9386-178063c8c094 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:57.750491 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a77ea970-1343-41be-9386-178063c8c094 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:57.750925 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a77ea970-1343-41be-9386-178063c8c094 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:57.912538 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a77ea970-1343-41be-9386-178063c8c094 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:57.925151 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a77ea970-1343-41be-9386-178063c8c094 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:57.926643 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a77ea970-1343-41be-9386-178063c8c094 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:57.927876 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a77ea970-1343-41be-9386-178063c8c094 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.191429 Apr 11 16:40:57.928457 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 277/573] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:57 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:40:58.946936 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-afd24120-6e51-44b0-9a6e-8e1b1923e368 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:40:58.947829 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-afd24120-6e51-44b0-9a6e-8e1b1923e368 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:40:58.957497 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-afd24120-6e51-44b0-9a6e-8e1b1923e368 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:58.958280 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-afd24120-6e51-44b0-9a6e-8e1b1923e368 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:58.959657 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-afd24120-6e51-44b0-9a6e-8e1b1923e368 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:40:58.960439 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-afd24120-6e51-44b0-9a6e-8e1b1923e368 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:40:59.120601 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-afd24120-6e51-44b0-9a6e-8e1b1923e368 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:59.130678 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-afd24120-6e51-44b0-9a6e-8e1b1923e368 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:59.132398 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-afd24120-6e51-44b0-9a6e-8e1b1923e368 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:40:59.133674 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-afd24120-6e51-44b0-9a6e-8e1b1923e368 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.190956 Apr 11 16:40:59.134245 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 297/574] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:40:58 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:41:00.152971 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-94fbde5b-97e8-4ee5-9cd5-458161a2863c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:00.153592 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-94fbde5b-97e8-4ee5-9cd5-458161a2863c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:00.161110 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-94fbde5b-97e8-4ee5-9cd5-458161a2863c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:00.161521 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-94fbde5b-97e8-4ee5-9cd5-458161a2863c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:00.162347 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-94fbde5b-97e8-4ee5-9cd5-458161a2863c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:00.162778 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-94fbde5b-97e8-4ee5-9cd5-458161a2863c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:00.314623 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-94fbde5b-97e8-4ee5-9cd5-458161a2863c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:00.324865 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-94fbde5b-97e8-4ee5-9cd5-458161a2863c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:00.326454 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-94fbde5b-97e8-4ee5-9cd5-458161a2863c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:00.328023 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-94fbde5b-97e8-4ee5-9cd5-458161a2863c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.179316 Apr 11 16:41:00.328667 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 278/575] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:41:00 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:41:00.646635 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-c7120fb4-0a87-4a99-bd61-a7bf7cd985a5 req-52a68fe0-e19d-4373-a439-e04270b23f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08685e5-3c41-4032-9633-cc591711221a", "name": "network-vif-plugged", "status": "completed", "tag": "8b85453b-0363-47d5-9902-93d848d7263e"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:41:00.661293 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-c7120fb4-0a87-4a99-bd61-a7bf7cd985a5 req-52a68fe0-e19d-4373-a439-e04270b23f68 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:00.662121 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-c7120fb4-0a87-4a99-bd61-a7bf7cd985a5 req-52a68fe0-e19d-4373-a439-e04270b23f68 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:00.685189 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-c7120fb4-0a87-4a99-bd61-a7bf7cd985a5 req-52a68fe0-e19d-4373-a439-e04270b23f68 service nova] Creating event network-vif-plugged:8b85453b-0363-47d5-9902-93d848d7263e for instance f08685e5-3c41-4032-9633-cc591711221a on hv-cinder-83716 Apr 11 16:41:00.694253 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-c7120fb4-0a87-4a99-bd61-a7bf7cd985a5 req-52a68fe0-e19d-4373-a439-e04270b23f68 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054756 Apr 11 16:41:00.695130 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 298/576] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:41:01.347108 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-b0121b89-3afb-4c6a-b812-6fd67ea16b7d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:01.347887 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-b0121b89-3afb-4c6a-b812-6fd67ea16b7d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:01.354624 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b0121b89-3afb-4c6a-b812-6fd67ea16b7d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:01.355190 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b0121b89-3afb-4c6a-b812-6fd67ea16b7d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:01.356057 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b0121b89-3afb-4c6a-b812-6fd67ea16b7d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:01.356592 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b0121b89-3afb-4c6a-b812-6fd67ea16b7d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:01.527100 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-b0121b89-3afb-4c6a-b812-6fd67ea16b7d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:01.538272 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-b0121b89-3afb-4c6a-b812-6fd67ea16b7d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:01.540549 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-b0121b89-3afb-4c6a-b812-6fd67ea16b7d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:01.542002 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-b0121b89-3afb-4c6a-b812-6fd67ea16b7d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.199373 Apr 11 16:41:01.542586 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 279/577] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:41:01 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:41:01.710013 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-9af98bad-5cb5-4506-a72f-cf9a723d9e9e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:41:01.711043 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-9af98bad-5cb5-4506-a72f-cf9a723d9e9e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:01.718779 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9af98bad-5cb5-4506-a72f-cf9a723d9e9e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:01.719228 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9af98bad-5cb5-4506-a72f-cf9a723d9e9e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:01.720053 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9af98bad-5cb5-4506-a72f-cf9a723d9e9e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:01.720501 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9af98bad-5cb5-4506-a72f-cf9a723d9e9e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:01.755789 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.objects.instance [None req-9af98bad-5cb5-4506-a72f-cf9a723d9e9e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lazy-loading 'flavor' on Instance uuid 2b8c15a9-44fe-41af-affd-6ea36d214007 {{(pid=123773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:41:01.940271 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-9af98bad-5cb5-4506-a72f-cf9a723d9e9e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "POST /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007/action" status: 200 len: 32 microversion: 2.1 time: 0.235125 Apr 11 16:41:01.940948 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 299/578] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Apr 11 16:41:01 2022] POST /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007/action => generated 32 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 16:41:01.953465 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d4578927-dcb3-4254-b9f4-42a839365118 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:01.954121 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d4578927-dcb3-4254-b9f4-42a839365118 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:01.960854 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d4578927-dcb3-4254-b9f4-42a839365118 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:01.961333 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d4578927-dcb3-4254-b9f4-42a839365118 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:01.962181 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d4578927-dcb3-4254-b9f4-42a839365118 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:01.962717 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d4578927-dcb3-4254-b9f4-42a839365118 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:02.118509 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d4578927-dcb3-4254-b9f4-42a839365118 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:02.127628 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d4578927-dcb3-4254-b9f4-42a839365118 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.178255 Apr 11 16:41:02.128182 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 280/579] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:01 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:41:02.563182 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-83347cd9-c509-4c10-b5c8-1a1538060679 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:02.563928 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-83347cd9-c509-4c10-b5c8-1a1538060679 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:02.570959 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-83347cd9-c509-4c10-b5c8-1a1538060679 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:02.571430 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-83347cd9-c509-4c10-b5c8-1a1538060679 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:02.572662 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-83347cd9-c509-4c10-b5c8-1a1538060679 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:02.573112 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-83347cd9-c509-4c10-b5c8-1a1538060679 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:02.715379 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-83347cd9-c509-4c10-b5c8-1a1538060679 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:02.724879 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-83347cd9-c509-4c10-b5c8-1a1538060679 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:02.726754 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-83347cd9-c509-4c10-b5c8-1a1538060679 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:02.728326 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-83347cd9-c509-4c10-b5c8-1a1538060679 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.169939 Apr 11 16:41:02.728991 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 300/580] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:41:02 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:41:03.147541 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-697fa025-844e-4205-a362-e6fc68a6de82 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:03.148635 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-697fa025-844e-4205-a362-e6fc68a6de82 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:03.157613 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-697fa025-844e-4205-a362-e6fc68a6de82 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:03.158060 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-697fa025-844e-4205-a362-e6fc68a6de82 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:03.158850 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-697fa025-844e-4205-a362-e6fc68a6de82 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:03.159339 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-697fa025-844e-4205-a362-e6fc68a6de82 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:03.303010 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-697fa025-844e-4205-a362-e6fc68a6de82 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:03.311525 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-697fa025-844e-4205-a362-e6fc68a6de82 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.169475 Apr 11 16:41:03.312268 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 281/581] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:03 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:03.747536 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3e87966a-ffa3-4f57-a534-8dca70112fa7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:03.748539 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3e87966a-ffa3-4f57-a534-8dca70112fa7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:03.755280 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3e87966a-ffa3-4f57-a534-8dca70112fa7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:03.755766 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3e87966a-ffa3-4f57-a534-8dca70112fa7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:03.756548 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3e87966a-ffa3-4f57-a534-8dca70112fa7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:03.756982 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3e87966a-ffa3-4f57-a534-8dca70112fa7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:03.894936 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3e87966a-ffa3-4f57-a534-8dca70112fa7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:03.904532 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3e87966a-ffa3-4f57-a534-8dca70112fa7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:03.906020 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3e87966a-ffa3-4f57-a534-8dca70112fa7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:03.907178 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3e87966a-ffa3-4f57-a534-8dca70112fa7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.163881 Apr 11 16:41:03.907793 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 301/582] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:41:03 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:41:04.329505 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-566a4c79-3766-4465-b191-e7b4659e1ac7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:04.330075 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-566a4c79-3766-4465-b191-e7b4659e1ac7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:04.337224 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-566a4c79-3766-4465-b191-e7b4659e1ac7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:04.337668 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-566a4c79-3766-4465-b191-e7b4659e1ac7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:04.338563 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-566a4c79-3766-4465-b191-e7b4659e1ac7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:04.339030 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-566a4c79-3766-4465-b191-e7b4659e1ac7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:04.473105 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-566a4c79-3766-4465-b191-e7b4659e1ac7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:04.481865 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-566a4c79-3766-4465-b191-e7b4659e1ac7 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.156366 Apr 11 16:41:04.482450 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 282/583] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:04 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:04.925794 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-870274e4-cf69-451d-a5b0-0367a612ba19 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:04.926497 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-870274e4-cf69-451d-a5b0-0367a612ba19 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:04.934140 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-870274e4-cf69-451d-a5b0-0367a612ba19 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:04.934588 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-870274e4-cf69-451d-a5b0-0367a612ba19 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:04.935362 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-870274e4-cf69-451d-a5b0-0367a612ba19 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:04.935823 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-870274e4-cf69-451d-a5b0-0367a612ba19 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:05.096363 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-870274e4-cf69-451d-a5b0-0367a612ba19 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:05.109930 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-870274e4-cf69-451d-a5b0-0367a612ba19 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:05.112601 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-870274e4-cf69-451d-a5b0-0367a612ba19 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:05.114554 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-870274e4-cf69-451d-a5b0-0367a612ba19 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.192490 Apr 11 16:41:05.115464 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 302/584] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:41:04 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:41:05.500263 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-2a26f837-4e1e-4bc7-8a35-e9951f2625cf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:05.500939 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-2a26f837-4e1e-4bc7-8a35-e9951f2625cf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:05.508904 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2a26f837-4e1e-4bc7-8a35-e9951f2625cf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:05.509402 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2a26f837-4e1e-4bc7-8a35-e9951f2625cf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:05.510407 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2a26f837-4e1e-4bc7-8a35-e9951f2625cf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:05.510793 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2a26f837-4e1e-4bc7-8a35-e9951f2625cf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:05.654593 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-2a26f837-4e1e-4bc7-8a35-e9951f2625cf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:05.670570 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-2a26f837-4e1e-4bc7-8a35-e9951f2625cf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.174489 Apr 11 16:41:05.671554 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 283/585] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:05 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:06.141102 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f037fddd-b18e-4727-b07a-221b60bc181b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:06.142147 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f037fddd-b18e-4727-b07a-221b60bc181b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:06.149339 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f037fddd-b18e-4727-b07a-221b60bc181b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:06.149971 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f037fddd-b18e-4727-b07a-221b60bc181b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:06.151388 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f037fddd-b18e-4727-b07a-221b60bc181b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:06.151973 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f037fddd-b18e-4727-b07a-221b60bc181b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:06.311573 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f037fddd-b18e-4727-b07a-221b60bc181b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:06.321495 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f037fddd-b18e-4727-b07a-221b60bc181b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:06.323893 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f037fddd-b18e-4727-b07a-221b60bc181b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:06.325136 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f037fddd-b18e-4727-b07a-221b60bc181b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.188787 Apr 11 16:41:06.325725 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 303/586] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:41:06 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:41:06.697292 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-067c9ca6-ab8d-4bb9-98e6-ba3afe856754 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:06.698032 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-067c9ca6-ab8d-4bb9-98e6-ba3afe856754 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:06.704975 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-067c9ca6-ab8d-4bb9-98e6-ba3afe856754 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:06.705416 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-067c9ca6-ab8d-4bb9-98e6-ba3afe856754 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:06.706181 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-067c9ca6-ab8d-4bb9-98e6-ba3afe856754 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:06.706607 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-067c9ca6-ab8d-4bb9-98e6-ba3afe856754 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:06.943867 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-067c9ca6-ab8d-4bb9-98e6-ba3afe856754 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:06.953652 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-067c9ca6-ab8d-4bb9-98e6-ba3afe856754 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.260379 Apr 11 16:41:06.954257 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 284/587] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:06 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:07.354971 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f5aa0b39-5aba-4e62-9869-4408fbda67a1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:07.354971 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f5aa0b39-5aba-4e62-9869-4408fbda67a1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:07.356303 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f5aa0b39-5aba-4e62-9869-4408fbda67a1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:07.357540 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f5aa0b39-5aba-4e62-9869-4408fbda67a1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:07.359042 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f5aa0b39-5aba-4e62-9869-4408fbda67a1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:07.359912 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f5aa0b39-5aba-4e62-9869-4408fbda67a1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:07.518130 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f5aa0b39-5aba-4e62-9869-4408fbda67a1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:07.528227 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f5aa0b39-5aba-4e62-9869-4408fbda67a1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:07.529758 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f5aa0b39-5aba-4e62-9869-4408fbda67a1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:07.531112 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f5aa0b39-5aba-4e62-9869-4408fbda67a1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.190754 Apr 11 16:41:07.531785 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 304/588] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:41:07 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:41:07.978219 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-29de0b12-968d-486f-beff-41b6f5e7bccf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:07.979286 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-29de0b12-968d-486f-beff-41b6f5e7bccf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:07.986235 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-29de0b12-968d-486f-beff-41b6f5e7bccf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:07.986598 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-29de0b12-968d-486f-beff-41b6f5e7bccf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:07.987391 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-29de0b12-968d-486f-beff-41b6f5e7bccf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:07.987849 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-29de0b12-968d-486f-beff-41b6f5e7bccf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:08.154934 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-29de0b12-968d-486f-beff-41b6f5e7bccf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:08.164215 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-29de0b12-968d-486f-beff-41b6f5e7bccf tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.189814 Apr 11 16:41:08.164799 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 285/589] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:07 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:08.550441 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-aaf176ae-3149-4962-9f0d-dca4e395c68e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:08.551276 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-aaf176ae-3149-4962-9f0d-dca4e395c68e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:08.558130 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-aaf176ae-3149-4962-9f0d-dca4e395c68e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:08.558627 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-aaf176ae-3149-4962-9f0d-dca4e395c68e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:08.559454 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-aaf176ae-3149-4962-9f0d-dca4e395c68e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:08.559972 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-aaf176ae-3149-4962-9f0d-dca4e395c68e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:08.714700 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-aaf176ae-3149-4962-9f0d-dca4e395c68e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:08.724352 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-aaf176ae-3149-4962-9f0d-dca4e395c68e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:08.726376 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-aaf176ae-3149-4962-9f0d-dca4e395c68e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:08.727836 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-aaf176ae-3149-4962-9f0d-dca4e395c68e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.181340 Apr 11 16:41:08.728645 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 305/590] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:41:08 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:41:09.191043 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-65d2f9d0-6709-46b9-96b7-30cb3325b75d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:09.191974 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-65d2f9d0-6709-46b9-96b7-30cb3325b75d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:09.199951 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-65d2f9d0-6709-46b9-96b7-30cb3325b75d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:09.200491 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-65d2f9d0-6709-46b9-96b7-30cb3325b75d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:09.201286 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-65d2f9d0-6709-46b9-96b7-30cb3325b75d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:09.201733 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-65d2f9d0-6709-46b9-96b7-30cb3325b75d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:09.349848 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-65d2f9d0-6709-46b9-96b7-30cb3325b75d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:09.358846 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-65d2f9d0-6709-46b9-96b7-30cb3325b75d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.172055 Apr 11 16:41:09.359451 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 286/591] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:09 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:09.755346 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-088fab8a-359e-4c86-a0a3-3ee1291e3155 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:09.756137 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-088fab8a-359e-4c86-a0a3-3ee1291e3155 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:09.763791 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-088fab8a-359e-4c86-a0a3-3ee1291e3155 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:09.764231 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-088fab8a-359e-4c86-a0a3-3ee1291e3155 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:09.765012 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-088fab8a-359e-4c86-a0a3-3ee1291e3155 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:09.765442 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-088fab8a-359e-4c86-a0a3-3ee1291e3155 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:09.904437 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-088fab8a-359e-4c86-a0a3-3ee1291e3155 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:09.913592 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-088fab8a-359e-4c86-a0a3-3ee1291e3155 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:09.915073 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-088fab8a-359e-4c86-a0a3-3ee1291e3155 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:09.916380 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-088fab8a-359e-4c86-a0a3-3ee1291e3155 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.165092 Apr 11 16:41:09.916949 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 306/592] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:41:09 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:41:10.377673 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-40692aca-86d1-4973-85fb-b95dd943855a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:10.378250 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-40692aca-86d1-4973-85fb-b95dd943855a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:10.385918 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-40692aca-86d1-4973-85fb-b95dd943855a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:10.386472 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-40692aca-86d1-4973-85fb-b95dd943855a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:10.387295 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-40692aca-86d1-4973-85fb-b95dd943855a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:10.387767 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-40692aca-86d1-4973-85fb-b95dd943855a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:10.539179 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-40692aca-86d1-4973-85fb-b95dd943855a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:10.548595 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-40692aca-86d1-4973-85fb-b95dd943855a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.175680 Apr 11 16:41:10.549242 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 287/593] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:10 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:10.935676 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-70d158c1-ac86-4146-a59d-36bca7568c7d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:10.936282 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-70d158c1-ac86-4146-a59d-36bca7568c7d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:10.943043 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-70d158c1-ac86-4146-a59d-36bca7568c7d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:10.943667 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-70d158c1-ac86-4146-a59d-36bca7568c7d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:10.944716 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-70d158c1-ac86-4146-a59d-36bca7568c7d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:10.945247 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-70d158c1-ac86-4146-a59d-36bca7568c7d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:11.095861 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-70d158c1-ac86-4146-a59d-36bca7568c7d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:11.111715 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-70d158c1-ac86-4146-a59d-36bca7568c7d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:11.113247 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-70d158c1-ac86-4146-a59d-36bca7568c7d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:11.114380 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-70d158c1-ac86-4146-a59d-36bca7568c7d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.183379 Apr 11 16:41:11.114966 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 307/594] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:41:10 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:41:11.574644 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-9edc3850-018e-41b2-9b3b-d74163e92ac9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:11.575797 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-9edc3850-018e-41b2-9b3b-d74163e92ac9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:11.587304 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9edc3850-018e-41b2-9b3b-d74163e92ac9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:11.588142 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9edc3850-018e-41b2-9b3b-d74163e92ac9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:11.589755 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9edc3850-018e-41b2-9b3b-d74163e92ac9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:11.590526 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9edc3850-018e-41b2-9b3b-d74163e92ac9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:11.785121 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-9edc3850-018e-41b2-9b3b-d74163e92ac9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:11.798399 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-9edc3850-018e-41b2-9b3b-d74163e92ac9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.230984 Apr 11 16:41:11.799514 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 288/595] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:11 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:12.137403 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b6fa7176-5c3d-4b33-884d-e82c67a3cab5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:12.138142 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b6fa7176-5c3d-4b33-884d-e82c67a3cab5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:12.145086 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6fa7176-5c3d-4b33-884d-e82c67a3cab5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:12.145532 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6fa7176-5c3d-4b33-884d-e82c67a3cab5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:12.146337 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6fa7176-5c3d-4b33-884d-e82c67a3cab5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:12.146751 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6fa7176-5c3d-4b33-884d-e82c67a3cab5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:12.342646 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b6fa7176-5c3d-4b33-884d-e82c67a3cab5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:12.353195 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b6fa7176-5c3d-4b33-884d-e82c67a3cab5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:12.355187 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b6fa7176-5c3d-4b33-884d-e82c67a3cab5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:12.357596 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b6fa7176-5c3d-4b33-884d-e82c67a3cab5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.225553 Apr 11 16:41:12.358294 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 308/596] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:41:12 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:41:12.817488 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e1b2cf3e-3a7e-486b-a445-c0499558b08e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:12.818087 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e1b2cf3e-3a7e-486b-a445-c0499558b08e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:12.825340 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e1b2cf3e-3a7e-486b-a445-c0499558b08e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:12.825783 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e1b2cf3e-3a7e-486b-a445-c0499558b08e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:12.826564 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e1b2cf3e-3a7e-486b-a445-c0499558b08e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:12.827049 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e1b2cf3e-3a7e-486b-a445-c0499558b08e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:12.979303 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e1b2cf3e-3a7e-486b-a445-c0499558b08e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:12.993541 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e1b2cf3e-3a7e-486b-a445-c0499558b08e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.179621 Apr 11 16:41:12.994630 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 289/597] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:12 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:13.392638 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-9a600a23-3c13-4b49-bb97-94d7c33e455a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:13.393667 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-9a600a23-3c13-4b49-bb97-94d7c33e455a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:13.405539 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9a600a23-3c13-4b49-bb97-94d7c33e455a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:13.406294 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9a600a23-3c13-4b49-bb97-94d7c33e455a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:13.407705 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9a600a23-3c13-4b49-bb97-94d7c33e455a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:13.408445 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9a600a23-3c13-4b49-bb97-94d7c33e455a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:13.609076 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9a600a23-3c13-4b49-bb97-94d7c33e455a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:13.637015 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9a600a23-3c13-4b49-bb97-94d7c33e455a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:13.640325 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9a600a23-3c13-4b49-bb97-94d7c33e455a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:13.643513 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-9a600a23-3c13-4b49-bb97-94d7c33e455a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1806 microversion: 2.20 time: 0.258123 Apr 11 16:41:13.664729 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 309/598] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:41:13 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1806 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:41:14.020725 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-b21158e6-6bd6-42ec-b42d-a8e59456e972 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:14.021744 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-b21158e6-6bd6-42ec-b42d-a8e59456e972 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:14.039342 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b21158e6-6bd6-42ec-b42d-a8e59456e972 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:14.040186 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b21158e6-6bd6-42ec-b42d-a8e59456e972 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:14.042121 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b21158e6-6bd6-42ec-b42d-a8e59456e972 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:14.042600 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b21158e6-6bd6-42ec-b42d-a8e59456e972 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:14.204874 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-b21158e6-6bd6-42ec-b42d-a8e59456e972 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:14.214993 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-b21158e6-6bd6-42ec-b42d-a8e59456e972 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.199420 Apr 11 16:41:14.215674 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 290/599] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:14 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:14.672416 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-469595a5-120d-4c43-9359-5e2d0ed440ee tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:14.673289 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-469595a5-120d-4c43-9359-5e2d0ed440ee tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:14.680913 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-469595a5-120d-4c43-9359-5e2d0ed440ee tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:14.681819 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-469595a5-120d-4c43-9359-5e2d0ed440ee tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:14.682764 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-469595a5-120d-4c43-9359-5e2d0ed440ee tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:14.683292 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-469595a5-120d-4c43-9359-5e2d0ed440ee tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:14.831774 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-469595a5-120d-4c43-9359-5e2d0ed440ee tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:14.847205 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-469595a5-120d-4c43-9359-5e2d0ed440ee tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:14.850103 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-469595a5-120d-4c43-9359-5e2d0ed440ee tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:14.852193 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-469595a5-120d-4c43-9359-5e2d0ed440ee tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1793 microversion: 2.20 time: 0.183505 Apr 11 16:41:14.853355 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 310/600] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:41:14 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1793 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:41:15.240845 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e7d7b3a1-bdab-40d1-9f4a-336111e43c66 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:15.241541 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e7d7b3a1-bdab-40d1-9f4a-336111e43c66 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:15.249345 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e7d7b3a1-bdab-40d1-9f4a-336111e43c66 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:15.249795 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e7d7b3a1-bdab-40d1-9f4a-336111e43c66 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:15.250593 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e7d7b3a1-bdab-40d1-9f4a-336111e43c66 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:15.251023 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e7d7b3a1-bdab-40d1-9f4a-336111e43c66 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:15.418673 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e7d7b3a1-bdab-40d1-9f4a-336111e43c66 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:15.427627 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e7d7b3a1-bdab-40d1-9f4a-336111e43c66 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.190722 Apr 11 16:41:15.428270 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 291/601] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:15 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:16.448779 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1976ad3c-7343-4b6f-b3de-7c81c61c801c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:16.449677 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1976ad3c-7343-4b6f-b3de-7c81c61c801c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:16.456398 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1976ad3c-7343-4b6f-b3de-7c81c61c801c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:16.456842 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1976ad3c-7343-4b6f-b3de-7c81c61c801c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:16.457645 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1976ad3c-7343-4b6f-b3de-7c81c61c801c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:16.458070 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1976ad3c-7343-4b6f-b3de-7c81c61c801c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:16.606085 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1976ad3c-7343-4b6f-b3de-7c81c61c801c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:16.615187 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1976ad3c-7343-4b6f-b3de-7c81c61c801c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.170192 Apr 11 16:41:16.615851 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 311/602] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:16 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:17.017700 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-048b59da-8762-429d-b04b-047ff543acb2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:17.018473 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-048b59da-8762-429d-b04b-047ff543acb2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:17.026036 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-048b59da-8762-429d-b04b-047ff543acb2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:17.026647 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-048b59da-8762-429d-b04b-047ff543acb2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:17.027562 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-048b59da-8762-429d-b04b-047ff543acb2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:17.028144 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-048b59da-8762-429d-b04b-047ff543acb2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:17.174861 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.objects.instance [None req-048b59da-8762-429d-b04b-047ff543acb2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lazy-loading 'services' on Instance uuid a0822de2-ba61-4e09-985e-efdbc3fb523a {{(pid=123774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:41:17.295443 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-048b59da-8762-429d-b04b-047ff543acb2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a/os-volume_attachments/0ddcd8bc-d9cd-49c0-87cd-04d89476d1af" status: 202 len: 0 microversion: 2.1 time: 0.281401 Apr 11 16:41:17.296426 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 292/603] 10.222.0.65 () {58 vars in 1415 bytes} [Mon Apr 11 16:41:17 2022] DELETE /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a/os-volume_attachments/0ddcd8bc-d9cd-49c0-87cd-04d89476d1af => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:41:17.647961 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-cbefbe3f-0e50-439a-905a-513b8c384eb3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:17.648571 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-cbefbe3f-0e50-439a-905a-513b8c384eb3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:17.656564 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cbefbe3f-0e50-439a-905a-513b8c384eb3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:17.656995 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cbefbe3f-0e50-439a-905a-513b8c384eb3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:17.657790 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cbefbe3f-0e50-439a-905a-513b8c384eb3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:17.658216 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cbefbe3f-0e50-439a-905a-513b8c384eb3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:17.806519 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-cbefbe3f-0e50-439a-905a-513b8c384eb3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:17.815399 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-cbefbe3f-0e50-439a-905a-513b8c384eb3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.171969 Apr 11 16:41:17.816039 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 312/604] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:17 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:18.459270 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-b98e4339-cb5d-4519-a2f3-57810d957ef8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:18.459898 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-b98e4339-cb5d-4519-a2f3-57810d957ef8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:18.467419 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b98e4339-cb5d-4519-a2f3-57810d957ef8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:18.467895 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b98e4339-cb5d-4519-a2f3-57810d957ef8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:18.468672 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b98e4339-cb5d-4519-a2f3-57810d957ef8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:18.469102 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b98e4339-cb5d-4519-a2f3-57810d957ef8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:18.499784 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-b98e4339-cb5d-4519-a2f3-57810d957ef8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Going to try to terminate instance {{(pid=123774) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:41:18.608762 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-b98e4339-cb5d-4519-a2f3-57810d957ef8 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a" status: 204 len: 0 microversion: 2.1 time: 0.153198 Apr 11 16:41:18.609595 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 293/605] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:41:18 2022] DELETE /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:41:18.618357 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c12a62d6-f228-426e-8920-a096cf600889 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:18.619004 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c12a62d6-f228-426e-8920-a096cf600889 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:18.625874 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c12a62d6-f228-426e-8920-a096cf600889 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:18.626420 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c12a62d6-f228-426e-8920-a096cf600889 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:18.627197 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c12a62d6-f228-426e-8920-a096cf600889 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:18.627617 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c12a62d6-f228-426e-8920-a096cf600889 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:18.834753 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-cb73f4fe-0618-4445-ae9d-451f77b0abb9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:18.835678 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-cb73f4fe-0618-4445-ae9d-451f77b0abb9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:18.843203 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-cb73f4fe-0618-4445-ae9d-451f77b0abb9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:18.843881 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-cb73f4fe-0618-4445-ae9d-451f77b0abb9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:18.844851 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-cb73f4fe-0618-4445-ae9d-451f77b0abb9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:18.845384 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-cb73f4fe-0618-4445-ae9d-451f77b0abb9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:19.092797 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c12a62d6-f228-426e-8920-a096cf600889 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:19.101870 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c12a62d6-f228-426e-8920-a096cf600889 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a" status: 200 len: 1513 microversion: 2.1 time: 0.487474 Apr 11 16:41:19.102857 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 313/606] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:18 2022] GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a => generated 1513 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:19.106786 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-cb73f4fe-0618-4445-ae9d-451f77b0abb9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:19.115561 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-cb73f4fe-0618-4445-ae9d-451f77b0abb9 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.285997 Apr 11 16:41:19.116357 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 294/607] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:18 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:41:20.126513 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-111c04af-8525-4dbb-b523-13e9529626a2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:20.127176 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-111c04af-8525-4dbb-b523-13e9529626a2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:20.134550 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c973de09-0c06-4230-8a4d-7cb2a46cc715 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:20.135422 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-111c04af-8525-4dbb-b523-13e9529626a2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:20.135422 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-111c04af-8525-4dbb-b523-13e9529626a2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:20.135774 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c973de09-0c06-4230-8a4d-7cb2a46cc715 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:20.136104 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-111c04af-8525-4dbb-b523-13e9529626a2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:20.136842 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-111c04af-8525-4dbb-b523-13e9529626a2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:20.142168 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c973de09-0c06-4230-8a4d-7cb2a46cc715 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:20.142600 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c973de09-0c06-4230-8a4d-7cb2a46cc715 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:20.143380 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c973de09-0c06-4230-8a4d-7cb2a46cc715 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:20.143847 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c973de09-0c06-4230-8a4d-7cb2a46cc715 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:20.377648 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c973de09-0c06-4230-8a4d-7cb2a46cc715 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:20.381675 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-111c04af-8525-4dbb-b523-13e9529626a2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:20.388579 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c973de09-0c06-4230-8a4d-7cb2a46cc715 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.257893 Apr 11 16:41:20.389451 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 295/608] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:20 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:41:20.392946 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-111c04af-8525-4dbb-b523-13e9529626a2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a" status: 200 len: 1513 microversion: 2.1 time: 0.270625 Apr 11 16:41:20.393773 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 314/609] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:20 2022] GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a => generated 1513 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:21.190466 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-a7739dfa-5bb9-4b3b-a0b9-f00194ff7948 req-886af8d1-7aca-43c6-a3b1-a0c775dc08f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0822de2-ba61-4e09-985e-efdbc3fb523a", "name": "network-vif-deleted", "tag": "83db28d4-bc87-43b7-b0cf-a32332df89a5"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:41:21.201313 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-a7739dfa-5bb9-4b3b-a0b9-f00194ff7948 req-886af8d1-7aca-43c6-a3b1-a0c775dc08f2 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:21.201941 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-a7739dfa-5bb9-4b3b-a0b9-f00194ff7948 req-886af8d1-7aca-43c6-a3b1-a0c775dc08f2 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:21.214947 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-a7739dfa-5bb9-4b3b-a0b9-f00194ff7948 req-886af8d1-7aca-43c6-a3b1-a0c775dc08f2 service nova] Creating event network-vif-deleted:83db28d4-bc87-43b7-b0cf-a32332df89a5 for instance a0822de2-ba61-4e09-985e-efdbc3fb523a on hv-cinder-83716 Apr 11 16:41:21.220120 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-a7739dfa-5bb9-4b3b-a0b9-f00194ff7948 req-886af8d1-7aca-43c6-a3b1-a0c775dc08f2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120716 Apr 11 16:41:21.220738 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 296/610] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:41:21.409742 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-fc58c487-ac4a-425a-b48b-c58fad3bb5e4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:21.410634 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-fc58c487-ac4a-425a-b48b-c58fad3bb5e4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:21.412731 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-964a9562-7a63-4e65-bb26-bb1ec7c1b88f tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:21.413651 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-964a9562-7a63-4e65-bb26-bb1ec7c1b88f tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:21.420403 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fc58c487-ac4a-425a-b48b-c58fad3bb5e4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:21.420935 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fc58c487-ac4a-425a-b48b-c58fad3bb5e4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:21.421845 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fc58c487-ac4a-425a-b48b-c58fad3bb5e4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:21.422351 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-964a9562-7a63-4e65-bb26-bb1ec7c1b88f tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:21.422557 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fc58c487-ac4a-425a-b48b-c58fad3bb5e4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:21.422974 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-964a9562-7a63-4e65-bb26-bb1ec7c1b88f tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:21.423949 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-964a9562-7a63-4e65-bb26-bb1ec7c1b88f tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:21.424472 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-964a9562-7a63-4e65-bb26-bb1ec7c1b88f tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:21.459454 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-964a9562-7a63-4e65-bb26-bb1ec7c1b88f tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:21.460129 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-964a9562-7a63-4e65-bb26-bb1ec7c1b88f tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:21.460736 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.objects.instance [None req-964a9562-7a63-4e65-bb26-bb1ec7c1b88f tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lazy-loading 'fault' on Instance uuid a0822de2-ba61-4e09-985e-efdbc3fb523a {{(pid=123774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:41:21.570321 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-964a9562-7a63-4e65-bb26-bb1ec7c1b88f tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:21.581263 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-964a9562-7a63-4e65-bb26-bb1ec7c1b88f tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a" status: 200 len: 1308 microversion: 2.1 time: 0.173549 Apr 11 16:41:21.581864 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 297/611] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:21 2022] GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:41:21.659207 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-fc58c487-ac4a-425a-b48b-c58fad3bb5e4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:21.670435 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-fc58c487-ac4a-425a-b48b-c58fad3bb5e4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.266139 Apr 11 16:41:21.671215 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 315/612] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:21 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:22.606863 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-146b5c67-4e88-4055-89a0-a7f08d896730 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:22.607498 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-146b5c67-4e88-4055-89a0-a7f08d896730 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: a0822de2-ba61-4e09-985e-efdbc3fb523a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:22.614398 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-146b5c67-4e88-4055-89a0-a7f08d896730 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:22.614902 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-146b5c67-4e88-4055-89a0-a7f08d896730 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:22.615620 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-146b5c67-4e88-4055-89a0-a7f08d896730 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:22.616081 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-146b5c67-4e88-4055-89a0-a7f08d896730 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:22.631494 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-146b5c67-4e88-4055-89a0-a7f08d896730 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] HTTP exception thrown: Instance a0822de2-ba61-4e09-985e-efdbc3fb523a could not be found. Apr 11 16:41:22.632108 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-146b5c67-4e88-4055-89a0-a7f08d896730 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Returning 404 to user: Instance a0822de2-ba61-4e09-985e-efdbc3fb523a could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:41:22.633006 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-146b5c67-4e88-4055-89a0-a7f08d896730 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a" status: 404 len: 111 microversion: 2.1 time: 0.030267 Apr 11 16:41:22.633609 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 298/613] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:22 2022] GET /compute/v2.1/servers/a0822de2-ba61-4e09-985e-efdbc3fb523a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:41:22.687263 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-043af5f5-00b3-41a5-bd0f-e834466b8e92 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:22.687923 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-043af5f5-00b3-41a5-bd0f-e834466b8e92 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:22.695231 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-043af5f5-00b3-41a5-bd0f-e834466b8e92 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:22.695706 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-043af5f5-00b3-41a5-bd0f-e834466b8e92 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:22.696666 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-043af5f5-00b3-41a5-bd0f-e834466b8e92 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:22.697109 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-043af5f5-00b3-41a5-bd0f-e834466b8e92 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:22.898770 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-043af5f5-00b3-41a5-bd0f-e834466b8e92 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:22.909183 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-043af5f5-00b3-41a5-bd0f-e834466b8e92 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.225777 Apr 11 16:41:22.909820 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 316/614] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:22 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:23.927590 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-8dffe02c-f541-486f-83cd-6f3b9991890d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:23.928193 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-8dffe02c-f541-486f-83cd-6f3b9991890d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:23.935568 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8dffe02c-f541-486f-83cd-6f3b9991890d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:23.936039 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8dffe02c-f541-486f-83cd-6f3b9991890d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:23.936819 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8dffe02c-f541-486f-83cd-6f3b9991890d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:23.937242 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8dffe02c-f541-486f-83cd-6f3b9991890d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:24.266593 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8dffe02c-f541-486f-83cd-6f3b9991890d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:24.275741 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-8dffe02c-f541-486f-83cd-6f3b9991890d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.352179 Apr 11 16:41:24.276356 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 299/615] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:23 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:41:25.294364 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-cb679a94-de04-4834-9a0c-3dba7a05407c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:25.295019 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-cb679a94-de04-4834-9a0c-3dba7a05407c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:25.301680 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cb679a94-de04-4834-9a0c-3dba7a05407c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:25.302120 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cb679a94-de04-4834-9a0c-3dba7a05407c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:25.302928 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cb679a94-de04-4834-9a0c-3dba7a05407c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:25.303351 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cb679a94-de04-4834-9a0c-3dba7a05407c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:25.446872 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-cb679a94-de04-4834-9a0c-3dba7a05407c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:25.456097 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-cb679a94-de04-4834-9a0c-3dba7a05407c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.166305 Apr 11 16:41:25.456702 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 317/616] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:25 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:26.474697 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e7b1bebf-9bbe-4da2-91d7-e2ad5fdc3413 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:26.476022 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e7b1bebf-9bbe-4da2-91d7-e2ad5fdc3413 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:26.486322 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e7b1bebf-9bbe-4da2-91d7-e2ad5fdc3413 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:26.487524 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e7b1bebf-9bbe-4da2-91d7-e2ad5fdc3413 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:26.488877 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e7b1bebf-9bbe-4da2-91d7-e2ad5fdc3413 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:26.489375 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e7b1bebf-9bbe-4da2-91d7-e2ad5fdc3413 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:26.653883 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e7b1bebf-9bbe-4da2-91d7-e2ad5fdc3413 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:26.662215 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e7b1bebf-9bbe-4da2-91d7-e2ad5fdc3413 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.191414 Apr 11 16:41:26.662832 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 300/617] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:26 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:27.685481 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-eaba6506-40e0-4c53-a0a0-aade73640163 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:27.686134 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-eaba6506-40e0-4c53-a0a0-aade73640163 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:27.693131 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-eaba6506-40e0-4c53-a0a0-aade73640163 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:27.693563 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-eaba6506-40e0-4c53-a0a0-aade73640163 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:27.694362 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-eaba6506-40e0-4c53-a0a0-aade73640163 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:27.694797 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-eaba6506-40e0-4c53-a0a0-aade73640163 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:27.846676 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-eaba6506-40e0-4c53-a0a0-aade73640163 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:27.855689 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-eaba6506-40e0-4c53-a0a0-aade73640163 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.176677 Apr 11 16:41:27.856259 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 318/618] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:27 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:28.874187 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-bc811425-c8cc-409b-901f-3b4ac02583af tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:28.874854 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-bc811425-c8cc-409b-901f-3b4ac02583af tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:28.881772 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bc811425-c8cc-409b-901f-3b4ac02583af tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:28.882214 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bc811425-c8cc-409b-901f-3b4ac02583af tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:28.883011 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bc811425-c8cc-409b-901f-3b4ac02583af tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:28.883466 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bc811425-c8cc-409b-901f-3b4ac02583af tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:29.046041 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-bc811425-c8cc-409b-901f-3b4ac02583af tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:29.061127 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-bc811425-c8cc-409b-901f-3b4ac02583af tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.190865 Apr 11 16:41:29.062207 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 301/619] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:28 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:30.082883 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-40590d23-a33b-438b-8508-7743d4850365 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:30.084267 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-40590d23-a33b-438b-8508-7743d4850365 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:30.097277 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-40590d23-a33b-438b-8508-7743d4850365 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:30.098147 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-40590d23-a33b-438b-8508-7743d4850365 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:30.099157 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-40590d23-a33b-438b-8508-7743d4850365 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:30.099676 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-40590d23-a33b-438b-8508-7743d4850365 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:30.264301 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-40590d23-a33b-438b-8508-7743d4850365 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:30.273590 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-40590d23-a33b-438b-8508-7743d4850365 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.198170 Apr 11 16:41:30.274254 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 319/620] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:30 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:31.292375 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ca309e9b-953f-481e-b5dd-ec0859cd9d8e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:31.293017 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ca309e9b-953f-481e-b5dd-ec0859cd9d8e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:31.300078 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ca309e9b-953f-481e-b5dd-ec0859cd9d8e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:31.300526 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ca309e9b-953f-481e-b5dd-ec0859cd9d8e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:31.301335 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ca309e9b-953f-481e-b5dd-ec0859cd9d8e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:31.301754 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ca309e9b-953f-481e-b5dd-ec0859cd9d8e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:31.447586 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ca309e9b-953f-481e-b5dd-ec0859cd9d8e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:31.456542 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ca309e9b-953f-481e-b5dd-ec0859cd9d8e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.168309 Apr 11 16:41:31.457254 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 302/621] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:31 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:32.482670 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-7bb23568-1f88-4e98-b48f-b2af2a945603 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:32.483547 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-7bb23568-1f88-4e98-b48f-b2af2a945603 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:32.490236 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7bb23568-1f88-4e98-b48f-b2af2a945603 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:32.490683 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7bb23568-1f88-4e98-b48f-b2af2a945603 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:32.491466 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7bb23568-1f88-4e98-b48f-b2af2a945603 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:32.491936 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7bb23568-1f88-4e98-b48f-b2af2a945603 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:32.642022 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-7bb23568-1f88-4e98-b48f-b2af2a945603 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:32.651031 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-7bb23568-1f88-4e98-b48f-b2af2a945603 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.172354 Apr 11 16:41:32.651661 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 320/622] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:32 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:33.677523 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e276d2ff-8ccf-464a-bba6-65524e06a289 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:33.678253 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e276d2ff-8ccf-464a-bba6-65524e06a289 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:33.685340 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e276d2ff-8ccf-464a-bba6-65524e06a289 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:33.685815 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e276d2ff-8ccf-464a-bba6-65524e06a289 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:33.686599 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e276d2ff-8ccf-464a-bba6-65524e06a289 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:33.687033 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e276d2ff-8ccf-464a-bba6-65524e06a289 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:33.844738 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e276d2ff-8ccf-464a-bba6-65524e06a289 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:33.854303 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e276d2ff-8ccf-464a-bba6-65524e06a289 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1736 microversion: 2.1 time: 0.180648 Apr 11 16:41:33.854919 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 303/623] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:33 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:34.647743 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ba832cce-bdec-403f-8422-76d9207f7f19 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-775489066", "imageRef": "e989c938-7b7a-445c-aec9-596e81d35104", "flavorRef": "452", "networks": [{"uuid": "b5c235fd-58a1-4013-a70e-85ace28807d0"}]}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:41:34.707056 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.network.neutron [None req-ba832cce-bdec-403f-8422-76d9207f7f19 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] validate_networks() for [('b5c235fd-58a1-4013-a70e-85ace28807d0', None, None, None, None, None)] {{(pid=123773) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:41:34.875620 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-46121472-46f0-4121-9796-eb82da9237f2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:34.876805 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-46121472-46f0-4121-9796-eb82da9237f2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:34.887153 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-46121472-46f0-4121-9796-eb82da9237f2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:34.887966 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-46121472-46f0-4121-9796-eb82da9237f2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:34.889005 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-46121472-46f0-4121-9796-eb82da9237f2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:34.889462 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-46121472-46f0-4121-9796-eb82da9237f2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:35.239260 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-46121472-46f0-4121-9796-eb82da9237f2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:35.248594 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-46121472-46f0-4121-9796-eb82da9237f2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1716 microversion: 2.1 time: 0.379832 Apr 11 16:41:35.249226 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 304/624] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:34 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1716 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:35.315675 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f7c2e7b0-62bb-43e6-a2e2-89a52166b4dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:35.316454 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f7c2e7b0-62bb-43e6-a2e2-89a52166b4dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:35.317742 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-ba832cce-bdec-403f-8422-76d9207f7f19 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Flavor limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:41:35.318396 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-ba832cce-bdec-403f-8422-76d9207f7f19 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Image limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:41:35.319206 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-ba832cce-bdec-403f-8422-76d9207f7f19 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Flavor pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:41:35.319899 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-ba832cce-bdec-403f-8422-76d9207f7f19 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Image pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:41:35.320538 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-ba832cce-bdec-403f-8422-76d9207f7f19 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:41:35.327122 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f7c2e7b0-62bb-43e6-a2e2-89a52166b4dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:35.327984 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f7c2e7b0-62bb-43e6-a2e2-89a52166b4dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:35.329490 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f7c2e7b0-62bb-43e6-a2e2-89a52166b4dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:35.330031 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ba832cce-bdec-403f-8422-76d9207f7f19 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:35.330484 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f7c2e7b0-62bb-43e6-a2e2-89a52166b4dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:35.330638 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ba832cce-bdec-403f-8422-76d9207f7f19 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:35.331260 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ba832cce-bdec-403f-8422-76d9207f7f19 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:35.331729 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ba832cce-bdec-403f-8422-76d9207f7f19 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:35.349879 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-ba832cce-bdec-403f-8422-76d9207f7f19 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Getting quotas for project 6d6d2866c13744368b0762634b43a1be. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:41:35.354397 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-ba832cce-bdec-403f-8422-76d9207f7f19 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Getting quotas for user 18ec3557c23547689f3a254667fcb27f and project 6d6d2866c13744368b0762634b43a1be. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:41:35.366168 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ba832cce-bdec-403f-8422-76d9207f7f19 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Going to run 1 instances... {{(pid=123773) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:41:35.368687 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ba832cce-bdec-403f-8422-76d9207f7f19 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e989c938-7b7a-445c-aec9-596e81d35104',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:41:35.419556 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ba832cce-bdec-403f-8422-76d9207f7f19 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.775529 Apr 11 16:41:35.421126 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 321/625] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Apr 11 16:41:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 16:41:35.434691 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c786452e-8519-465c-b1a2-6d521fe28168 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:35.435730 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c786452e-8519-465c-b1a2-6d521fe28168 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:35.454282 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-f7c2e7b0-62bb-43e6-a2e2-89a52166b4dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] HTTP exception thrown: Cannot 'detach_volume' instance 2b8c15a9-44fe-41af-affd-6ea36d214007 while it is in vm_state rescued Apr 11 16:41:35.455402 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f7c2e7b0-62bb-43e6-a2e2-89a52166b4dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Returning 409 to user: Cannot 'detach_volume' instance 2b8c15a9-44fe-41af-affd-6ea36d214007 while it is in vm_state rescued {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:41:35.456874 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f7c2e7b0-62bb-43e6-a2e2-89a52166b4dc tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007/os-volume_attachments/6c6b71eb-3344-4a0e-8bb2-98e196d4b5ed" status: 409 len: 152 microversion: 2.1 time: 0.146646 Apr 11 16:41:35.457842 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 305/626] 10.222.0.65 () {58 vars in 1415 bytes} [Mon Apr 11 16:41:35 2022] DELETE /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007/os-volume_attachments/6c6b71eb-3344-4a0e-8bb2-98e196d4b5ed => generated 152 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 11 16:41:35.471623 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-19354e40-9102-4c21-9c3c-89c87979877b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:41:35.472523 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-19354e40-9102-4c21-9c3c-89c87979877b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:35.483379 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-19354e40-9102-4c21-9c3c-89c87979877b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:35.484236 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-19354e40-9102-4c21-9c3c-89c87979877b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:35.486061 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-19354e40-9102-4c21-9c3c-89c87979877b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:35.486495 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-19354e40-9102-4c21-9c3c-89c87979877b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:35.504247 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c786452e-8519-465c-b1a2-6d521fe28168 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:35.512611 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c786452e-8519-465c-b1a2-6d521fe28168 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799" status: 200 len: 1218 microversion: 2.1 time: 0.082067 Apr 11 16:41:35.513259 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 322/627] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:35 2022] GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:41:35.583330 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-19354e40-9102-4c21-9c3c-89c87979877b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "POST /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007/action" status: 202 len: 0 microversion: 2.1 time: 0.118263 Apr 11 16:41:35.585031 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 306/628] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Apr 11 16:41:35 2022] POST /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:41:35.597163 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1438495c-8e4c-4263-9734-bde6f2133b74 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:35.597928 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1438495c-8e4c-4263-9734-bde6f2133b74 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:35.605648 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1438495c-8e4c-4263-9734-bde6f2133b74 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:35.606086 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1438495c-8e4c-4263-9734-bde6f2133b74 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:35.606932 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1438495c-8e4c-4263-9734-bde6f2133b74 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:35.608344 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1438495c-8e4c-4263-9734-bde6f2133b74 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:35.855229 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1438495c-8e4c-4263-9734-bde6f2133b74 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:35.865524 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1438495c-8e4c-4263-9734-bde6f2133b74 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1724 microversion: 2.1 time: 0.272534 Apr 11 16:41:35.866417 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 323/629] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:35 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:36.537732 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-2b2d3d78-2015-40ed-ade2-770b57009d5c tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:36.539689 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-2b2d3d78-2015-40ed-ade2-770b57009d5c tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:36.549415 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2b2d3d78-2015-40ed-ade2-770b57009d5c tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:36.549415 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2b2d3d78-2015-40ed-ade2-770b57009d5c tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:36.550624 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2b2d3d78-2015-40ed-ade2-770b57009d5c tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:36.551623 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2b2d3d78-2015-40ed-ade2-770b57009d5c tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:36.672460 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-2b2d3d78-2015-40ed-ade2-770b57009d5c tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:36.681623 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-2b2d3d78-2015-40ed-ade2-770b57009d5c tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799" status: 200 len: 1278 microversion: 2.1 time: 0.153080 Apr 11 16:41:36.692230 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 307/630] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:36 2022] GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:36.893010 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-a24f2983-02be-488c-8dc8-fe0da7ea12f2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:36.893755 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-a24f2983-02be-488c-8dc8-fe0da7ea12f2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:36.904573 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a24f2983-02be-488c-8dc8-fe0da7ea12f2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:36.905017 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a24f2983-02be-488c-8dc8-fe0da7ea12f2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:36.905897 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a24f2983-02be-488c-8dc8-fe0da7ea12f2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:36.906673 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a24f2983-02be-488c-8dc8-fe0da7ea12f2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:37.078468 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-a24f2983-02be-488c-8dc8-fe0da7ea12f2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:37.090213 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-a24f2983-02be-488c-8dc8-fe0da7ea12f2 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1724 microversion: 2.1 time: 0.200821 Apr 11 16:41:37.090992 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 324/631] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:36 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:37.700103 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ea5221dd-13ad-456c-beef-092e295c1c22 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:37.700663 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ea5221dd-13ad-456c-beef-092e295c1c22 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:37.707678 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ea5221dd-13ad-456c-beef-092e295c1c22 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:37.708141 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ea5221dd-13ad-456c-beef-092e295c1c22 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:37.708925 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ea5221dd-13ad-456c-beef-092e295c1c22 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:37.709352 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ea5221dd-13ad-456c-beef-092e295c1c22 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:37.858363 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ea5221dd-13ad-456c-beef-092e295c1c22 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:37.866748 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ea5221dd-13ad-456c-beef-092e295c1c22 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799" status: 200 len: 1318 microversion: 2.1 time: 0.170803 Apr 11 16:41:37.867338 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 308/632] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:37 2022] GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:38.109329 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-159a05eb-256b-44d5-90d6-3e58483f34db tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:38.109977 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-159a05eb-256b-44d5-90d6-3e58483f34db tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:38.117190 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-159a05eb-256b-44d5-90d6-3e58483f34db tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:38.117750 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-159a05eb-256b-44d5-90d6-3e58483f34db tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:38.118839 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-159a05eb-256b-44d5-90d6-3e58483f34db tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:38.119278 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-159a05eb-256b-44d5-90d6-3e58483f34db tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:38.267436 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-159a05eb-256b-44d5-90d6-3e58483f34db tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:38.276504 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-159a05eb-256b-44d5-90d6-3e58483f34db tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1724 microversion: 2.1 time: 0.171119 Apr 11 16:41:38.277106 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 325/633] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:38 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:38.884466 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d5e8dfce-86f5-46da-ac5e-3e9fb12cf377 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:38.885113 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d5e8dfce-86f5-46da-ac5e-3e9fb12cf377 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:38.892298 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d5e8dfce-86f5-46da-ac5e-3e9fb12cf377 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:38.892741 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d5e8dfce-86f5-46da-ac5e-3e9fb12cf377 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:38.893539 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d5e8dfce-86f5-46da-ac5e-3e9fb12cf377 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:38.893970 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d5e8dfce-86f5-46da-ac5e-3e9fb12cf377 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:39.055136 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d5e8dfce-86f5-46da-ac5e-3e9fb12cf377 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:39.067384 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d5e8dfce-86f5-46da-ac5e-3e9fb12cf377 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799" status: 200 len: 1318 microversion: 2.1 time: 0.186939 Apr 11 16:41:39.068650 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 309/634] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:38 2022] GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:39.299273 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-684c30e5-7161-45e1-b26e-1164a223c943 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:39.300691 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-684c30e5-7161-45e1-b26e-1164a223c943 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:39.312655 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-684c30e5-7161-45e1-b26e-1164a223c943 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:39.313558 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-684c30e5-7161-45e1-b26e-1164a223c943 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:39.314973 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-684c30e5-7161-45e1-b26e-1164a223c943 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:39.315817 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-684c30e5-7161-45e1-b26e-1164a223c943 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:39.486163 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-684c30e5-7161-45e1-b26e-1164a223c943 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:39.496738 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-684c30e5-7161-45e1-b26e-1164a223c943 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1724 microversion: 2.1 time: 0.204753 Apr 11 16:41:39.498067 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 326/635] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:39 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:39.911779 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-a7d2c88f-65ad-4ee8-b492-2c2041cf762f req-92b7531e-c654-4f83-96c9-815f75df3c26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa3bb50-7e54-4694-81eb-50bb747a7799", "tag": "b058bc56-8816-4186-9f44-ecf806a00bc1"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:41:39.920896 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-a7d2c88f-65ad-4ee8-b492-2c2041cf762f req-92b7531e-c654-4f83-96c9-815f75df3c26 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:39.921356 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-a7d2c88f-65ad-4ee8-b492-2c2041cf762f req-92b7531e-c654-4f83-96c9-815f75df3c26 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:39.933130 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-a7d2c88f-65ad-4ee8-b492-2c2041cf762f req-92b7531e-c654-4f83-96c9-815f75df3c26 service nova] Creating event network-changed:b058bc56-8816-4186-9f44-ecf806a00bc1 for instance aaa3bb50-7e54-4694-81eb-50bb747a7799 on hv-cinder-83716 Apr 11 16:41:39.938254 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-a7d2c88f-65ad-4ee8-b492-2c2041cf762f req-92b7531e-c654-4f83-96c9-815f75df3c26 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101299 Apr 11 16:41:39.938873 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 310/636] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:41:40.095798 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-122b04c6-fbb0-45b0-acf5-eb027c2eaf64 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:40.096814 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-122b04c6-fbb0-45b0-acf5-eb027c2eaf64 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:40.107285 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-122b04c6-fbb0-45b0-acf5-eb027c2eaf64 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:40.108119 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-122b04c6-fbb0-45b0-acf5-eb027c2eaf64 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:40.109513 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-122b04c6-fbb0-45b0-acf5-eb027c2eaf64 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:40.110278 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-122b04c6-fbb0-45b0-acf5-eb027c2eaf64 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:40.305238 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-122b04c6-fbb0-45b0-acf5-eb027c2eaf64 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:40.315242 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-122b04c6-fbb0-45b0-acf5-eb027c2eaf64 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799" status: 200 len: 1318 microversion: 2.1 time: 0.226344 Apr 11 16:41:40.316075 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 327/637] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:40 2022] GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:40.516921 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f8fa0fbd-df96-425a-a4a5-875667ad8a16 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:40.517705 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f8fa0fbd-df96-425a-a4a5-875667ad8a16 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:40.529337 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f8fa0fbd-df96-425a-a4a5-875667ad8a16 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:40.529865 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f8fa0fbd-df96-425a-a4a5-875667ad8a16 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:40.530836 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f8fa0fbd-df96-425a-a4a5-875667ad8a16 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:40.531341 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f8fa0fbd-df96-425a-a4a5-875667ad8a16 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:40.699877 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f8fa0fbd-df96-425a-a4a5-875667ad8a16 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:40.708063 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f8fa0fbd-df96-425a-a4a5-875667ad8a16 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1730 microversion: 2.1 time: 0.195947 Apr 11 16:41:40.708678 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 311/638] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:40 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:40.724965 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-00eb6066-c70a-46d0-8242-4833da59e9f5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:40.725459 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-00eb6066-c70a-46d0-8242-4833da59e9f5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:40.732652 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-00eb6066-c70a-46d0-8242-4833da59e9f5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:40.733123 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-00eb6066-c70a-46d0-8242-4833da59e9f5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:40.733909 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-00eb6066-c70a-46d0-8242-4833da59e9f5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:40.734341 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-00eb6066-c70a-46d0-8242-4833da59e9f5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:40.829832 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-00eb6066-c70a-46d0-8242-4833da59e9f5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108587 Apr 11 16:41:40.830656 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 328/639] 10.222.0.65 () {58 vars in 1274 bytes} [Mon Apr 11 16:41:40 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:41:41.338332 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ac48825a-f865-42cd-8d51-1a9abb968b4c tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:41.339258 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ac48825a-f865-42cd-8d51-1a9abb968b4c tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:41.349702 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ac48825a-f865-42cd-8d51-1a9abb968b4c tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:41.350457 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ac48825a-f865-42cd-8d51-1a9abb968b4c tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:41.351721 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ac48825a-f865-42cd-8d51-1a9abb968b4c tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:41.352537 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ac48825a-f865-42cd-8d51-1a9abb968b4c tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:41.891251 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ac48825a-f865-42cd-8d51-1a9abb968b4c tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:41.901321 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ac48825a-f865-42cd-8d51-1a9abb968b4c tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799" status: 200 len: 1318 microversion: 2.1 time: 0.569699 Apr 11 16:41:41.902099 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 312/640] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:41 2022] GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799 => generated 1318 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:42.229359 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-7251fe75-8e87-4548-bf81-f4a4ddbea9fe req-11245505-af82-434b-81de-8df707369cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b8c15a9-44fe-41af-affd-6ea36d214007", "tag": "851afbae-5cd1-4945-b6c6-66059ebc4234"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:41:42.241782 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-7251fe75-8e87-4548-bf81-f4a4ddbea9fe req-11245505-af82-434b-81de-8df707369cf6 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:42.242683 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-7251fe75-8e87-4548-bf81-f4a4ddbea9fe req-11245505-af82-434b-81de-8df707369cf6 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:42.255928 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-7251fe75-8e87-4548-bf81-f4a4ddbea9fe req-11245505-af82-434b-81de-8df707369cf6 service nova] Creating event network-changed:851afbae-5cd1-4945-b6c6-66059ebc4234 for instance 2b8c15a9-44fe-41af-affd-6ea36d214007 on hv-cinder-83716 Apr 11 16:41:42.261796 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-7251fe75-8e87-4548-bf81-f4a4ddbea9fe req-11245505-af82-434b-81de-8df707369cf6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038101 Apr 11 16:41:42.262510 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 329/641] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:41:42.925947 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-591a5800-bed8-4a87-8e10-7024d599b11f tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:42.927009 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-591a5800-bed8-4a87-8e10-7024d599b11f tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:42.934872 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-591a5800-bed8-4a87-8e10-7024d599b11f tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:42.935316 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-591a5800-bed8-4a87-8e10-7024d599b11f tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:42.936407 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-591a5800-bed8-4a87-8e10-7024d599b11f tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:42.936849 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-591a5800-bed8-4a87-8e10-7024d599b11f tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:43.114067 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-591a5800-bed8-4a87-8e10-7024d599b11f tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:43.123014 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-591a5800-bed8-4a87-8e10-7024d599b11f tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799" status: 200 len: 1318 microversion: 2.1 time: 0.200963 Apr 11 16:41:43.124756 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 313/642] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:42 2022] GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:44.149514 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-84eae23e-5a26-46b4-9cb8-c0c772eadac1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:44.150601 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-84eae23e-5a26-46b4-9cb8-c0c772eadac1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:44.157642 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-84eae23e-5a26-46b4-9cb8-c0c772eadac1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:44.158209 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-84eae23e-5a26-46b4-9cb8-c0c772eadac1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:44.159099 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-84eae23e-5a26-46b4-9cb8-c0c772eadac1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:44.159626 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-84eae23e-5a26-46b4-9cb8-c0c772eadac1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:44.289251 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-ac07fb03-86b3-4533-aaa4-077fa53a74c4 req-25e8e6b4-ddc0-4ab9-bbc1-ea0d42e37c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b8c15a9-44fe-41af-affd-6ea36d214007", "tag": "851afbae-5cd1-4945-b6c6-66059ebc4234"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:41:44.305699 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-ac07fb03-86b3-4533-aaa4-077fa53a74c4 req-25e8e6b4-ddc0-4ab9-bbc1-ea0d42e37c34 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:44.306326 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-ac07fb03-86b3-4533-aaa4-077fa53a74c4 req-25e8e6b4-ddc0-4ab9-bbc1-ea0d42e37c34 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:44.327829 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-ac07fb03-86b3-4533-aaa4-077fa53a74c4 req-25e8e6b4-ddc0-4ab9-bbc1-ea0d42e37c34 service nova] Creating event network-changed:851afbae-5cd1-4945-b6c6-66059ebc4234 for instance 2b8c15a9-44fe-41af-affd-6ea36d214007 on hv-cinder-83716 Apr 11 16:41:44.335117 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-84eae23e-5a26-46b4-9cb8-c0c772eadac1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:44.335708 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-ac07fb03-86b3-4533-aaa4-077fa53a74c4 req-25e8e6b4-ddc0-4ab9-bbc1-ea0d42e37c34 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054467 Apr 11 16:41:44.337073 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 314/643] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:41:44.344285 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-84eae23e-5a26-46b4-9cb8-c0c772eadac1 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799" status: 200 len: 1318 microversion: 2.1 time: 0.200287 Apr 11 16:41:44.344899 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 330/644] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:44 2022] GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:45.363945 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-4a5a2470-222d-4ccd-bf2a-81d2c2b421d4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:45.364984 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-4a5a2470-222d-4ccd-bf2a-81d2c2b421d4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:45.373453 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4a5a2470-222d-4ccd-bf2a-81d2c2b421d4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:45.374202 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4a5a2470-222d-4ccd-bf2a-81d2c2b421d4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:45.375574 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4a5a2470-222d-4ccd-bf2a-81d2c2b421d4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:45.376370 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4a5a2470-222d-4ccd-bf2a-81d2c2b421d4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:45.574945 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-4a5a2470-222d-4ccd-bf2a-81d2c2b421d4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:45.583486 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-4a5a2470-222d-4ccd-bf2a-81d2c2b421d4 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799" status: 200 len: 1318 microversion: 2.1 time: 0.224871 Apr 11 16:41:45.584125 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 315/645] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:45 2022] GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:46.608665 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d2afeb21-dcc4-46ad-926b-66d60358e49e tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:46.609443 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d2afeb21-dcc4-46ad-926b-66d60358e49e tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:46.616291 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d2afeb21-dcc4-46ad-926b-66d60358e49e tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:46.616755 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d2afeb21-dcc4-46ad-926b-66d60358e49e tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:46.617646 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d2afeb21-dcc4-46ad-926b-66d60358e49e tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:46.618112 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d2afeb21-dcc4-46ad-926b-66d60358e49e tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:46.768461 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d2afeb21-dcc4-46ad-926b-66d60358e49e tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:46.778434 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d2afeb21-dcc4-46ad-926b-66d60358e49e tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799" status: 200 len: 1318 microversion: 2.1 time: 0.173568 Apr 11 16:41:46.779495 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 331/646] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:46 2022] GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:41:46.916250 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-68ca38fd-cc15-418a-8bbe-ad269fc0387f req-ef26e6a9-2f99-44bc-851d-deb09b1854e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa3bb50-7e54-4694-81eb-50bb747a7799", "name": "network-vif-plugged", "status": "completed", "tag": "b058bc56-8816-4186-9f44-ecf806a00bc1"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:41:46.924819 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-68ca38fd-cc15-418a-8bbe-ad269fc0387f req-ef26e6a9-2f99-44bc-851d-deb09b1854e7 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:46.925255 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-68ca38fd-cc15-418a-8bbe-ad269fc0387f req-ef26e6a9-2f99-44bc-851d-deb09b1854e7 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:46.937283 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-68ca38fd-cc15-418a-8bbe-ad269fc0387f req-ef26e6a9-2f99-44bc-851d-deb09b1854e7 service nova] Creating event network-vif-plugged:b058bc56-8816-4186-9f44-ecf806a00bc1 for instance aaa3bb50-7e54-4694-81eb-50bb747a7799 on hv-cinder-83716 Apr 11 16:41:46.942328 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-68ca38fd-cc15-418a-8bbe-ad269fc0387f req-ef26e6a9-2f99-44bc-851d-deb09b1854e7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117157 Apr 11 16:41:46.942944 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 316/647] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:41:47.802265 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-606eab60-1cfe-48dd-9faa-ddd03fed5bd6 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:47.802933 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-606eab60-1cfe-48dd-9faa-ddd03fed5bd6 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:47.810926 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-606eab60-1cfe-48dd-9faa-ddd03fed5bd6 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:47.811369 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-606eab60-1cfe-48dd-9faa-ddd03fed5bd6 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:47.812195 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-606eab60-1cfe-48dd-9faa-ddd03fed5bd6 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:47.812628 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-606eab60-1cfe-48dd-9faa-ddd03fed5bd6 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:47.979356 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-606eab60-1cfe-48dd-9faa-ddd03fed5bd6 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:47.987781 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-606eab60-1cfe-48dd-9faa-ddd03fed5bd6 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799" status: 200 len: 1318 microversion: 2.1 time: 0.189356 Apr 11 16:41:47.988274 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 332/648] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:47 2022] GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:49.008681 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f0f6c4c9-8d6f-4082-801b-6c5b18c00725 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:49.009477 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f0f6c4c9-8d6f-4082-801b-6c5b18c00725 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:49.017251 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f0f6c4c9-8d6f-4082-801b-6c5b18c00725 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:49.017698 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f0f6c4c9-8d6f-4082-801b-6c5b18c00725 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:49.018665 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f0f6c4c9-8d6f-4082-801b-6c5b18c00725 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:49.019142 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f0f6c4c9-8d6f-4082-801b-6c5b18c00725 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:49.180709 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f0f6c4c9-8d6f-4082-801b-6c5b18c00725 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:49.189042 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f0f6c4c9-8d6f-4082-801b-6c5b18c00725 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799" status: 200 len: 1506 microversion: 2.1 time: 0.185923 Apr 11 16:41:49.189645 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 317/649] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:49 2022] GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799 => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:49.206115 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-549f462c-13da-4d4f-aa01-cd0d9b0d2224 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2b1c04e-6bf3-4935-8a11-958f431607f6", "device": "/dev/sdb"}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:41:49.207805 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-549f462c-13da-4d4f-aa01-cd0d9b0d2224 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:49.214757 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-549f462c-13da-4d4f-aa01-cd0d9b0d2224 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:49.215242 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-549f462c-13da-4d4f-aa01-cd0d9b0d2224 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:49.216172 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-549f462c-13da-4d4f-aa01-cd0d9b0d2224 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:49.216632 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-549f462c-13da-4d4f-aa01-cd0d9b0d2224 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:49.709673 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-549f462c-13da-4d4f-aa01-cd0d9b0d2224 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "POST /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.507455 Apr 11 16:41:49.710497 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 333/650] 10.222.0.65 () {60 vars in 1322 bytes} [Mon Apr 11 16:41:49 2022] POST /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799/os-volume_attachments => generated 194 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:41:53.010734 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-36186730-657a-4f06-ae94-c44682159208 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:41:53.011694 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-36186730-657a-4f06-ae94-c44682159208 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:53.018626 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-36186730-657a-4f06-ae94-c44682159208 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:53.019074 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-36186730-657a-4f06-ae94-c44682159208 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:53.019898 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-36186730-657a-4f06-ae94-c44682159208 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:53.020328 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-36186730-657a-4f06-ae94-c44682159208 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:53.099213 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-36186730-657a-4f06-ae94-c44682159208 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "POST /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d/action" status: 202 len: 0 microversion: 2.1 time: 0.093425 Apr 11 16:41:53.100187 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 318/651] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Apr 11 16:41:53 2022] POST /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:41:53.110535 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-665d37de-4a64-4748-b8bf-db7aca1ac640 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:53.111893 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-665d37de-4a64-4748-b8bf-db7aca1ac640 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:53.120608 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-665d37de-4a64-4748-b8bf-db7aca1ac640 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:53.121067 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-665d37de-4a64-4748-b8bf-db7aca1ac640 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:53.122222 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-665d37de-4a64-4748-b8bf-db7aca1ac640 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:53.122660 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-665d37de-4a64-4748-b8bf-db7aca1ac640 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:53.283864 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-665d37de-4a64-4748-b8bf-db7aca1ac640 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:53.292614 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-665d37de-4a64-4748-b8bf-db7aca1ac640 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1753 microversion: 2.1 time: 0.186575 Apr 11 16:41:53.293225 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 334/652] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:53 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1753 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:41:54.320315 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-774b6b03-ea3a-4c53-8d01-bc8ea7b6aeee tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:54.321286 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-774b6b03-ea3a-4c53-8d01-bc8ea7b6aeee tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:54.328057 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-774b6b03-ea3a-4c53-8d01-bc8ea7b6aeee tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:54.328520 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-774b6b03-ea3a-4c53-8d01-bc8ea7b6aeee tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:54.329279 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-774b6b03-ea3a-4c53-8d01-bc8ea7b6aeee tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:54.329705 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-774b6b03-ea3a-4c53-8d01-bc8ea7b6aeee tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:54.507368 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-774b6b03-ea3a-4c53-8d01-bc8ea7b6aeee tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:54.516733 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-774b6b03-ea3a-4c53-8d01-bc8ea7b6aeee tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1758 microversion: 2.1 time: 0.201424 Apr 11 16:41:54.517338 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 319/653] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:54 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1758 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:55.534982 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-7231ae91-d0f1-4920-a7a1-38d393ec3254 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:55.535712 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-7231ae91-d0f1-4920-a7a1-38d393ec3254 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:55.543221 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7231ae91-d0f1-4920-a7a1-38d393ec3254 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:55.543670 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7231ae91-d0f1-4920-a7a1-38d393ec3254 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:55.544504 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7231ae91-d0f1-4920-a7a1-38d393ec3254 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:55.544940 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7231ae91-d0f1-4920-a7a1-38d393ec3254 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:55.713376 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-7231ae91-d0f1-4920-a7a1-38d393ec3254 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:55.718797 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:41:55.722430 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: Mon Apr 11 16:41:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d (ip 10.222.0.65) !!! Apr 11 16:41:55.725917 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-7231ae91-d0f1-4920-a7a1-38d393ec3254 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1758 microversion: 2.1 time: 0.194929 Apr 11 16:41:55.727709 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 335/654] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:55 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1758 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:56.753034 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-78c39b9c-b4e6-49c0-8824-947c0e38a3c1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:56.753670 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-78c39b9c-b4e6-49c0-8824-947c0e38a3c1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:56.760722 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-78c39b9c-b4e6-49c0-8824-947c0e38a3c1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:56.761168 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-78c39b9c-b4e6-49c0-8824-947c0e38a3c1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:56.761945 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-78c39b9c-b4e6-49c0-8824-947c0e38a3c1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:56.762350 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-78c39b9c-b4e6-49c0-8824-947c0e38a3c1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:56.940381 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-78c39b9c-b4e6-49c0-8824-947c0e38a3c1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:56.950112 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-78c39b9c-b4e6-49c0-8824-947c0e38a3c1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1758 microversion: 2.1 time: 0.200986 Apr 11 16:41:56.950736 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 320/655] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:56 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1758 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:57.968131 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-21b166aa-5a65-4340-877b-febf735b9620 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:57.968766 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-21b166aa-5a65-4340-877b-febf735b9620 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:57.975566 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-21b166aa-5a65-4340-877b-febf735b9620 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:57.976175 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-21b166aa-5a65-4340-877b-febf735b9620 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:57.976978 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-21b166aa-5a65-4340-877b-febf735b9620 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:57.977432 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-21b166aa-5a65-4340-877b-febf735b9620 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:58.134032 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-21b166aa-5a65-4340-877b-febf735b9620 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:58.147221 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-21b166aa-5a65-4340-877b-febf735b9620 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1758 microversion: 2.1 time: 0.182755 Apr 11 16:41:58.148322 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 336/656] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:57 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:41:59.172568 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-18f5ce67-6bf9-4789-b802-8b3deec44457 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:41:59.173146 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-18f5ce67-6bf9-4789-b802-8b3deec44457 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:41:59.180435 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-18f5ce67-6bf9-4789-b802-8b3deec44457 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:59.180875 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-18f5ce67-6bf9-4789-b802-8b3deec44457 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:59.181652 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-18f5ce67-6bf9-4789-b802-8b3deec44457 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:41:59.182075 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-18f5ce67-6bf9-4789-b802-8b3deec44457 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:41:59.337979 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-18f5ce67-6bf9-4789-b802-8b3deec44457 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:41:59.353696 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-18f5ce67-6bf9-4789-b802-8b3deec44457 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1758 microversion: 2.1 time: 0.184750 Apr 11 16:41:59.354307 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 321/657] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:41:59 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:00.373083 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b52c0404-c804-4114-b675-8afa05f4c9e1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:00.373747 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b52c0404-c804-4114-b675-8afa05f4c9e1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:00.382312 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b52c0404-c804-4114-b675-8afa05f4c9e1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:00.382767 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b52c0404-c804-4114-b675-8afa05f4c9e1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:00.384197 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b52c0404-c804-4114-b675-8afa05f4c9e1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:00.384918 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b52c0404-c804-4114-b675-8afa05f4c9e1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:00.599396 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b52c0404-c804-4114-b675-8afa05f4c9e1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:00.608253 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b52c0404-c804-4114-b675-8afa05f4c9e1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1758 microversion: 2.1 time: 0.239566 Apr 11 16:42:00.608832 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 337/658] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:00 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1758 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:01.627379 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-80443cfa-87f9-4ad4-9e8c-90bc775aaa8b tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:01.628231 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-80443cfa-87f9-4ad4-9e8c-90bc775aaa8b tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:01.635972 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-80443cfa-87f9-4ad4-9e8c-90bc775aaa8b tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:01.636450 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-80443cfa-87f9-4ad4-9e8c-90bc775aaa8b tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:01.637253 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-80443cfa-87f9-4ad4-9e8c-90bc775aaa8b tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:01.637691 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-80443cfa-87f9-4ad4-9e8c-90bc775aaa8b tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:01.811806 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-80443cfa-87f9-4ad4-9e8c-90bc775aaa8b tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:01.826535 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-80443cfa-87f9-4ad4-9e8c-90bc775aaa8b tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1758 microversion: 2.1 time: 0.203231 Apr 11 16:42:01.827142 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 322/659] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:01 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1758 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:02.845779 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b5eeb699-9b6a-4718-8634-0de9ee48739f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:02.846366 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b5eeb699-9b6a-4718-8634-0de9ee48739f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:02.854830 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b5eeb699-9b6a-4718-8634-0de9ee48739f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:02.855600 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b5eeb699-9b6a-4718-8634-0de9ee48739f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:02.856975 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b5eeb699-9b6a-4718-8634-0de9ee48739f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:02.857515 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b5eeb699-9b6a-4718-8634-0de9ee48739f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:03.016491 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b5eeb699-9b6a-4718-8634-0de9ee48739f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:03.025123 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b5eeb699-9b6a-4718-8634-0de9ee48739f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1758 microversion: 2.1 time: 0.183523 Apr 11 16:42:03.025695 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 338/660] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:02 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:04.042844 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e5877e33-a1d1-4b7d-af80-50c2d82aa7bd tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:04.043401 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e5877e33-a1d1-4b7d-af80-50c2d82aa7bd tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:04.050375 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e5877e33-a1d1-4b7d-af80-50c2d82aa7bd tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:04.050820 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e5877e33-a1d1-4b7d-af80-50c2d82aa7bd tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:04.051601 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e5877e33-a1d1-4b7d-af80-50c2d82aa7bd tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:04.052065 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e5877e33-a1d1-4b7d-af80-50c2d82aa7bd tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:04.204775 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e5877e33-a1d1-4b7d-af80-50c2d82aa7bd tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:04.213412 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e5877e33-a1d1-4b7d-af80-50c2d82aa7bd tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1758 microversion: 2.1 time: 0.174553 Apr 11 16:42:04.213999 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 323/661] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:04 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:42:05.231479 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-8f98d866-8ca4-49bc-80c0-862b4541ee28 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:05.232174 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-8f98d866-8ca4-49bc-80c0-862b4541ee28 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:05.239230 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8f98d866-8ca4-49bc-80c0-862b4541ee28 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:05.239677 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8f98d866-8ca4-49bc-80c0-862b4541ee28 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:05.240486 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8f98d866-8ca4-49bc-80c0-862b4541ee28 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:05.240921 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8f98d866-8ca4-49bc-80c0-862b4541ee28 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:05.408488 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-8f98d866-8ca4-49bc-80c0-862b4541ee28 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:05.417820 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-8f98d866-8ca4-49bc-80c0-862b4541ee28 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1758 microversion: 2.1 time: 0.190422 Apr 11 16:42:05.418426 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 339/662] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:05 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:06.435742 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5ecc0042-17ce-4082-a1d6-19769bd9bcac tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:06.436568 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5ecc0042-17ce-4082-a1d6-19769bd9bcac tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:06.443459 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5ecc0042-17ce-4082-a1d6-19769bd9bcac tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:06.443917 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5ecc0042-17ce-4082-a1d6-19769bd9bcac tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:06.444818 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5ecc0042-17ce-4082-a1d6-19769bd9bcac tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:06.445244 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5ecc0042-17ce-4082-a1d6-19769bd9bcac tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:06.601670 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5ecc0042-17ce-4082-a1d6-19769bd9bcac tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:06.609873 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5ecc0042-17ce-4082-a1d6-19769bd9bcac tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1758 microversion: 2.1 time: 0.178237 Apr 11 16:42:06.610461 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 324/663] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:06 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:07.628031 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-20ef3b00-215e-451d-9a40-b3e57d4925f1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:07.628610 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-20ef3b00-215e-451d-9a40-b3e57d4925f1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:07.637169 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-20ef3b00-215e-451d-9a40-b3e57d4925f1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:07.637614 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-20ef3b00-215e-451d-9a40-b3e57d4925f1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:07.638397 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-20ef3b00-215e-451d-9a40-b3e57d4925f1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:07.638823 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-20ef3b00-215e-451d-9a40-b3e57d4925f1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:07.801370 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-20ef3b00-215e-451d-9a40-b3e57d4925f1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:07.809779 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-20ef3b00-215e-451d-9a40-b3e57d4925f1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1758 microversion: 2.1 time: 0.185820 Apr 11 16:42:07.812801 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 340/664] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:07 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:08.836220 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-38e74431-a0b1-4e9a-ba6f-8c76c8d862d7 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:08.836789 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-38e74431-a0b1-4e9a-ba6f-8c76c8d862d7 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:08.843670 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-38e74431-a0b1-4e9a-ba6f-8c76c8d862d7 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:08.844158 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-38e74431-a0b1-4e9a-ba6f-8c76c8d862d7 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:08.844944 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-38e74431-a0b1-4e9a-ba6f-8c76c8d862d7 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:08.845377 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-38e74431-a0b1-4e9a-ba6f-8c76c8d862d7 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:09.000088 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-38e74431-a0b1-4e9a-ba6f-8c76c8d862d7 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:09.009770 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-38e74431-a0b1-4e9a-ba6f-8c76c8d862d7 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1758 microversion: 2.1 time: 0.177846 Apr 11 16:42:09.010877 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 325/665] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:08 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:10.028316 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-21b280cf-7675-4e1d-8193-def18d77a3a1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:10.028878 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-21b280cf-7675-4e1d-8193-def18d77a3a1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:10.036422 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-21b280cf-7675-4e1d-8193-def18d77a3a1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:10.036865 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-21b280cf-7675-4e1d-8193-def18d77a3a1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:10.037676 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-21b280cf-7675-4e1d-8193-def18d77a3a1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:10.038188 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-21b280cf-7675-4e1d-8193-def18d77a3a1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:10.200495 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-21b280cf-7675-4e1d-8193-def18d77a3a1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:10.208480 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-21b280cf-7675-4e1d-8193-def18d77a3a1 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1758 microversion: 2.1 time: 0.184917 Apr 11 16:42:10.209061 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 341/666] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:10 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:11.225471 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-59bdc719-6345-4823-983c-5708a916bcc9 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:11.226414 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-59bdc719-6345-4823-983c-5708a916bcc9 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:11.233269 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-59bdc719-6345-4823-983c-5708a916bcc9 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:11.233708 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-59bdc719-6345-4823-983c-5708a916bcc9 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:11.234487 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-59bdc719-6345-4823-983c-5708a916bcc9 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:11.234987 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-59bdc719-6345-4823-983c-5708a916bcc9 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:11.384647 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-59bdc719-6345-4823-983c-5708a916bcc9 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:11.393340 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-59bdc719-6345-4823-983c-5708a916bcc9 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1758 microversion: 2.1 time: 0.171801 Apr 11 16:42:11.393930 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 326/667] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:11 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:12.411386 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-7dc7ecc2-da89-4b4d-a238-489f411ccde8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:12.412002 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-7dc7ecc2-da89-4b4d-a238-489f411ccde8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:12.418851 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7dc7ecc2-da89-4b4d-a238-489f411ccde8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:12.419289 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7dc7ecc2-da89-4b4d-a238-489f411ccde8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:12.420088 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7dc7ecc2-da89-4b4d-a238-489f411ccde8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:12.420539 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7dc7ecc2-da89-4b4d-a238-489f411ccde8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:12.572543 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-7dc7ecc2-da89-4b4d-a238-489f411ccde8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:12.581175 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-7dc7ecc2-da89-4b4d-a238-489f411ccde8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1758 microversion: 2.1 time: 0.173726 Apr 11 16:42:12.581742 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 342/668] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:12 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:12.610543 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:42:12.611469 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: Mon Apr 11 16:42:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 16:42:13.282235 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-6d20f050-c277-47c4-be24-e45a56e57fe2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:13.282644 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-6d20f050-c277-47c4-be24-e45a56e57fe2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:13.290038 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6d20f050-c277-47c4-be24-e45a56e57fe2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:13.290507 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6d20f050-c277-47c4-be24-e45a56e57fe2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:13.291271 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6d20f050-c277-47c4-be24-e45a56e57fe2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:13.291731 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6d20f050-c277-47c4-be24-e45a56e57fe2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:13.374976 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.objects.instance [None req-6d20f050-c277-47c4-be24-e45a56e57fe2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lazy-loading 'services' on Instance uuid aaa3bb50-7e54-4694-81eb-50bb747a7799 {{(pid=123774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:42:13.450598 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-6d20f050-c277-47c4-be24-e45a56e57fe2 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "DELETE /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799/os-volume_attachments/b2b1c04e-6bf3-4935-8a11-958f431607f6" status: 202 len: 0 microversion: 2.1 time: 0.172348 Apr 11 16:42:13.451196 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 327/669] 10.222.0.65 () {58 vars in 1415 bytes} [Mon Apr 11 16:42:13 2022] DELETE /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799/os-volume_attachments/b2b1c04e-6bf3-4935-8a11-958f431607f6 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:42:13.600842 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ae9b596f-0c66-4941-b641-391b2ad14cbf tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:13.601577 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ae9b596f-0c66-4941-b641-391b2ad14cbf tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:13.608330 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ae9b596f-0c66-4941-b641-391b2ad14cbf tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:13.608789 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ae9b596f-0c66-4941-b641-391b2ad14cbf tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:13.609558 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ae9b596f-0c66-4941-b641-391b2ad14cbf tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:13.609988 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ae9b596f-0c66-4941-b641-391b2ad14cbf tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:13.751388 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ae9b596f-0c66-4941-b641-391b2ad14cbf tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:13.759443 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ae9b596f-0c66-4941-b641-391b2ad14cbf tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1758 microversion: 2.1 time: 0.162426 Apr 11 16:42:13.760047 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 343/670] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:13 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:14.780134 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-29f05487-e6d9-441e-999d-1f5bc1038577 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:14.780701 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-29f05487-e6d9-441e-999d-1f5bc1038577 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:14.787158 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-29f05487-e6d9-441e-999d-1f5bc1038577 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:14.787603 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-29f05487-e6d9-441e-999d-1f5bc1038577 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:14.788434 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-29f05487-e6d9-441e-999d-1f5bc1038577 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:14.789506 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-29f05487-e6d9-441e-999d-1f5bc1038577 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:14.951381 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-29f05487-e6d9-441e-999d-1f5bc1038577 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:14.959500 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-29f05487-e6d9-441e-999d-1f5bc1038577 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1761 microversion: 2.1 time: 0.184498 Apr 11 16:42:14.960301 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 328/671] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:14 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1761 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:15.623315 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-09822ca8-21de-43ad-a747-1986f0026fc3 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:15.623874 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-09822ca8-21de-43ad-a747-1986f0026fc3 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:15.630547 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-09822ca8-21de-43ad-a747-1986f0026fc3 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:15.631000 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-09822ca8-21de-43ad-a747-1986f0026fc3 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:15.631859 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-09822ca8-21de-43ad-a747-1986f0026fc3 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:15.632323 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-09822ca8-21de-43ad-a747-1986f0026fc3 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:15.658372 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-09822ca8-21de-43ad-a747-1986f0026fc3 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Going to try to terminate instance {{(pid=123773) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:42:15.734120 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-09822ca8-21de-43ad-a747-1986f0026fc3 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "DELETE /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799" status: 204 len: 0 microversion: 2.1 time: 0.114759 Apr 11 16:42:15.734739 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 344/672] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:42:15 2022] DELETE /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:42:15.743980 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c4940a09-a8f4-4f1a-a528-dd23faf60711 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:15.744587 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c4940a09-a8f4-4f1a-a528-dd23faf60711 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:15.751127 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c4940a09-a8f4-4f1a-a528-dd23faf60711 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:15.751576 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c4940a09-a8f4-4f1a-a528-dd23faf60711 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:15.752394 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c4940a09-a8f4-4f1a-a528-dd23faf60711 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:15.752827 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c4940a09-a8f4-4f1a-a528-dd23faf60711 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:15.893572 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c4940a09-a8f4-4f1a-a528-dd23faf60711 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:15.901443 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c4940a09-a8f4-4f1a-a528-dd23faf60711 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799" status: 200 len: 1512 microversion: 2.1 time: 0.161714 Apr 11 16:42:15.902060 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 329/673] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:15 2022] GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:16.919349 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-e8aeda1b-0e8a-4664-9432-6dd6ca7f9f58 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:16.920223 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-e8aeda1b-0e8a-4664-9432-6dd6ca7f9f58 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:16.926979 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e8aeda1b-0e8a-4664-9432-6dd6ca7f9f58 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:16.927434 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e8aeda1b-0e8a-4664-9432-6dd6ca7f9f58 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:16.928454 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e8aeda1b-0e8a-4664-9432-6dd6ca7f9f58 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:16.929297 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e8aeda1b-0e8a-4664-9432-6dd6ca7f9f58 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:17.061278 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-e8aeda1b-0e8a-4664-9432-6dd6ca7f9f58 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:17.069679 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-e8aeda1b-0e8a-4664-9432-6dd6ca7f9f58 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799" status: 200 len: 1512 microversion: 2.1 time: 0.154563 Apr 11 16:42:17.070297 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 345/674] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:16 2022] GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:17.244873 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-3eeaeb06-2bda-4ea6-89a9-132681be90ee tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:17.245383 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-3eeaeb06-2bda-4ea6-89a9-132681be90ee tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:17.251996 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3eeaeb06-2bda-4ea6-89a9-132681be90ee tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:17.252453 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3eeaeb06-2bda-4ea6-89a9-132681be90ee tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:17.253216 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3eeaeb06-2bda-4ea6-89a9-132681be90ee tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:17.253703 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3eeaeb06-2bda-4ea6-89a9-132681be90ee tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:17.335821 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.objects.instance [None req-3eeaeb06-2bda-4ea6-89a9-132681be90ee tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lazy-loading 'services' on Instance uuid 0db1c6a9-bc5a-45f7-bbd3-590292385768 {{(pid=123774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:42:17.410429 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-3eeaeb06-2bda-4ea6-89a9-132681be90ee tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768/os-volume_attachments/bc9aa79a-7c7a-4675-8028-78b4cdadabdb" status: 202 len: 0 microversion: 2.1 time: 0.270390 Apr 11 16:42:17.411223 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 330/675] 10.222.0.65 () {58 vars in 1415 bytes} [Mon Apr 11 16:42:17 2022] DELETE /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768/os-volume_attachments/bc9aa79a-7c7a-4675-8028-78b4cdadabdb => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:42:18.087377 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-88967954-b69f-44b2-bd4a-74bdbe5cb787 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:18.088050 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-88967954-b69f-44b2-bd4a-74bdbe5cb787 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:18.094806 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-88967954-b69f-44b2-bd4a-74bdbe5cb787 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:18.095259 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-88967954-b69f-44b2-bd4a-74bdbe5cb787 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:18.096056 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-88967954-b69f-44b2-bd4a-74bdbe5cb787 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:18.096476 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-88967954-b69f-44b2-bd4a-74bdbe5cb787 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:18.236884 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-88967954-b69f-44b2-bd4a-74bdbe5cb787 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:18.245229 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-88967954-b69f-44b2-bd4a-74bdbe5cb787 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799" status: 200 len: 1512 microversion: 2.1 time: 0.162063 Apr 11 16:42:18.245828 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 346/676] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:18 2022] GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:19.025900 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-62d981cf-9d09-4e38-a035-8dc327569f0a req-a755fb4f-bd32-4d76-bc91-094c04c3d986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa3bb50-7e54-4694-81eb-50bb747a7799", "name": "network-vif-deleted", "tag": "b058bc56-8816-4186-9f44-ecf806a00bc1"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:42:19.040211 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-62d981cf-9d09-4e38-a035-8dc327569f0a req-a755fb4f-bd32-4d76-bc91-094c04c3d986 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:19.040653 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-62d981cf-9d09-4e38-a035-8dc327569f0a req-a755fb4f-bd32-4d76-bc91-094c04c3d986 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:19.052881 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-62d981cf-9d09-4e38-a035-8dc327569f0a req-a755fb4f-bd32-4d76-bc91-094c04c3d986 service nova] Creating event network-vif-deleted:b058bc56-8816-4186-9f44-ecf806a00bc1 for instance aaa3bb50-7e54-4694-81eb-50bb747a7799 on hv-cinder-83716 Apr 11 16:42:19.058128 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-62d981cf-9d09-4e38-a035-8dc327569f0a req-a755fb4f-bd32-4d76-bc91-094c04c3d986 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037014 Apr 11 16:42:19.058733 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 331/677] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:42:19.264088 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-75c7b9b5-6724-42b1-8d3d-1d4bd18a0d03 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:19.264854 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-75c7b9b5-6724-42b1-8d3d-1d4bd18a0d03 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:19.272489 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-75c7b9b5-6724-42b1-8d3d-1d4bd18a0d03 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:19.272954 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-75c7b9b5-6724-42b1-8d3d-1d4bd18a0d03 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:19.273718 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-75c7b9b5-6724-42b1-8d3d-1d4bd18a0d03 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:19.274141 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-75c7b9b5-6724-42b1-8d3d-1d4bd18a0d03 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:19.304768 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-75c7b9b5-6724-42b1-8d3d-1d4bd18a0d03 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:19.305215 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-75c7b9b5-6724-42b1-8d3d-1d4bd18a0d03 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:19.305650 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.objects.instance [None req-75c7b9b5-6724-42b1-8d3d-1d4bd18a0d03 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lazy-loading 'fault' on Instance uuid aaa3bb50-7e54-4694-81eb-50bb747a7799 {{(pid=123773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:42:19.350555 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-75c7b9b5-6724-42b1-8d3d-1d4bd18a0d03 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18ec3557c23547689f3a254667fcb27f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6d2866c13744368b0762634b43a1be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:19.358365 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-75c7b9b5-6724-42b1-8d3d-1d4bd18a0d03 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799" status: 200 len: 1308 microversion: 2.1 time: 0.099436 Apr 11 16:42:19.358934 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 347/678] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:19 2022] GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:19.585647 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-544bcc30-0a72-466c-9806-15df92838b9f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:42:19.592274 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-544bcc30-0a72-466c-9806-15df92838b9f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:19.592711 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-544bcc30-0a72-466c-9806-15df92838b9f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:19.614142 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-544bcc30-0a72-466c-9806-15df92838b9f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Going to try to stop instance {{(pid=123774) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 11 16:42:19.658180 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-544bcc30-0a72-466c-9806-15df92838b9f tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "POST /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768/action" status: 202 len: 0 microversion: 2.1 time: 0.076622 Apr 11 16:42:19.658787 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 332/679] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Apr 11 16:42:19 2022] POST /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:42:19.667137 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b580206c-1c57-4433-8e34-acb117b3baec tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:19.667877 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b580206c-1c57-4433-8e34-acb117b3baec tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:19.674556 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b580206c-1c57-4433-8e34-acb117b3baec tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:19.675266 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b580206c-1c57-4433-8e34-acb117b3baec tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:19.676183 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b580206c-1c57-4433-8e34-acb117b3baec tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:19.676586 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b580206c-1c57-4433-8e34-acb117b3baec tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:19.811843 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b580206c-1c57-4433-8e34-acb117b3baec tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:19.819975 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b580206c-1c57-4433-8e34-acb117b3baec tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1679 microversion: 2.1 time: 0.156658 Apr 11 16:42:19.820592 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 348/680] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:19 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:20.377739 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a78148a9-f0cd-4c17-9f71-41f610966199 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:20.378431 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a78148a9-f0cd-4c17-9f71-41f610966199 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] [instance: aaa3bb50-7e54-4694-81eb-50bb747a7799] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:20.385373 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a78148a9-f0cd-4c17-9f71-41f610966199 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:20.385821 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a78148a9-f0cd-4c17-9f71-41f610966199 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:20.386599 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a78148a9-f0cd-4c17-9f71-41f610966199 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:20.387032 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a78148a9-f0cd-4c17-9f71-41f610966199 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:20.401208 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-a78148a9-f0cd-4c17-9f71-41f610966199 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] HTTP exception thrown: Instance aaa3bb50-7e54-4694-81eb-50bb747a7799 could not be found. Apr 11 16:42:20.401801 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a78148a9-f0cd-4c17-9f71-41f610966199 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] Returning 404 to user: Instance aaa3bb50-7e54-4694-81eb-50bb747a7799 could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:42:20.402631 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a78148a9-f0cd-4c17-9f71-41f610966199 tempest-VolumesSnapshotTestJSON-1706842782 tempest-VolumesSnapshotTestJSON-1706842782-project] 10.222.0.65 "GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799" status: 404 len: 111 microversion: 2.1 time: 0.029847 Apr 11 16:42:20.403200 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 333/681] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:20 2022] GET /compute/v2.1/servers/aaa3bb50-7e54-4694-81eb-50bb747a7799 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:42:20.837881 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-92b56d3d-8e9a-4f72-b8a5-ed88ab204a78 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:20.838490 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-92b56d3d-8e9a-4f72-b8a5-ed88ab204a78 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:20.846277 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-92b56d3d-8e9a-4f72-b8a5-ed88ab204a78 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:20.846720 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-92b56d3d-8e9a-4f72-b8a5-ed88ab204a78 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:20.847513 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-92b56d3d-8e9a-4f72-b8a5-ed88ab204a78 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:20.847990 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-92b56d3d-8e9a-4f72-b8a5-ed88ab204a78 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:20.987116 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-92b56d3d-8e9a-4f72-b8a5-ed88ab204a78 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:20.995651 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-92b56d3d-8e9a-4f72-b8a5-ed88ab204a78 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1679 microversion: 2.1 time: 0.161695 Apr 11 16:42:20.996569 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 349/682] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:20 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:22.014667 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-9fbfe81c-c360-40a9-8a37-9f49b3d29134 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:22.015242 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-9fbfe81c-c360-40a9-8a37-9f49b3d29134 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:22.022086 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9fbfe81c-c360-40a9-8a37-9f49b3d29134 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:22.022529 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9fbfe81c-c360-40a9-8a37-9f49b3d29134 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:22.023323 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9fbfe81c-c360-40a9-8a37-9f49b3d29134 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:22.023782 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9fbfe81c-c360-40a9-8a37-9f49b3d29134 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:22.158620 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-9fbfe81c-c360-40a9-8a37-9f49b3d29134 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:22.168524 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-9fbfe81c-c360-40a9-8a37-9f49b3d29134 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1679 microversion: 2.1 time: 0.157742 Apr 11 16:42:22.169103 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 334/683] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:22 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:23.186663 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-83187210-5c26-445a-ac02-46da7d723634 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:23.187265 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-83187210-5c26-445a-ac02-46da7d723634 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:23.193987 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-83187210-5c26-445a-ac02-46da7d723634 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:23.194438 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-83187210-5c26-445a-ac02-46da7d723634 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:23.195209 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-83187210-5c26-445a-ac02-46da7d723634 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:23.195638 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-83187210-5c26-445a-ac02-46da7d723634 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:23.330164 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-83187210-5c26-445a-ac02-46da7d723634 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:23.338774 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-83187210-5c26-445a-ac02-46da7d723634 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1679 microversion: 2.1 time: 0.156094 Apr 11 16:42:23.339361 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 350/684] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:23 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:24.359695 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-3587e273-3f86-4456-8b7a-6cc5ddc9af70 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:24.360416 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-3587e273-3f86-4456-8b7a-6cc5ddc9af70 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:24.367078 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3587e273-3f86-4456-8b7a-6cc5ddc9af70 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:24.367530 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3587e273-3f86-4456-8b7a-6cc5ddc9af70 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:24.368301 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3587e273-3f86-4456-8b7a-6cc5ddc9af70 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:24.368764 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3587e273-3f86-4456-8b7a-6cc5ddc9af70 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:24.504538 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-3587e273-3f86-4456-8b7a-6cc5ddc9af70 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:24.512486 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-3587e273-3f86-4456-8b7a-6cc5ddc9af70 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1679 microversion: 2.1 time: 0.158088 Apr 11 16:42:24.513062 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 335/685] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:24 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:42:25.530464 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-18d94174-0067-4685-bcca-b170c025e55a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:25.531093 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-18d94174-0067-4685-bcca-b170c025e55a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:25.537826 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-18d94174-0067-4685-bcca-b170c025e55a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:25.538557 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-18d94174-0067-4685-bcca-b170c025e55a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:25.539890 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-18d94174-0067-4685-bcca-b170c025e55a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:25.540603 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-18d94174-0067-4685-bcca-b170c025e55a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:25.676872 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-18d94174-0067-4685-bcca-b170c025e55a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:25.684965 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-18d94174-0067-4685-bcca-b170c025e55a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1679 microversion: 2.1 time: 0.158551 Apr 11 16:42:25.685520 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 351/686] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:25 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:26.702946 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a1573eb7-d222-48a5-b7ff-48f0d3349fbb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:26.703523 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a1573eb7-d222-48a5-b7ff-48f0d3349fbb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:26.710686 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a1573eb7-d222-48a5-b7ff-48f0d3349fbb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:26.711137 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a1573eb7-d222-48a5-b7ff-48f0d3349fbb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:26.711947 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a1573eb7-d222-48a5-b7ff-48f0d3349fbb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:26.712374 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a1573eb7-d222-48a5-b7ff-48f0d3349fbb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:26.847154 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a1573eb7-d222-48a5-b7ff-48f0d3349fbb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:26.855248 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a1573eb7-d222-48a5-b7ff-48f0d3349fbb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1679 microversion: 2.1 time: 0.156185 Apr 11 16:42:26.856031 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 336/687] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:26 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:27.875042 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-893de75d-ec85-4ba3-8d8f-f02e031c7d41 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:27.875692 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-893de75d-ec85-4ba3-8d8f-f02e031c7d41 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:27.882619 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-893de75d-ec85-4ba3-8d8f-f02e031c7d41 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:27.883065 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-893de75d-ec85-4ba3-8d8f-f02e031c7d41 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:27.883884 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-893de75d-ec85-4ba3-8d8f-f02e031c7d41 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:27.884336 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-893de75d-ec85-4ba3-8d8f-f02e031c7d41 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:28.017077 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-893de75d-ec85-4ba3-8d8f-f02e031c7d41 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:28.027361 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-893de75d-ec85-4ba3-8d8f-f02e031c7d41 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1679 microversion: 2.1 time: 0.156347 Apr 11 16:42:28.028326 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 352/688] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:27 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:29.046390 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-111ca638-b30f-4f69-a500-ee0fff2ad7f6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:29.046947 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-111ca638-b30f-4f69-a500-ee0fff2ad7f6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:29.054520 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-111ca638-b30f-4f69-a500-ee0fff2ad7f6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:29.054961 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-111ca638-b30f-4f69-a500-ee0fff2ad7f6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:29.055774 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-111ca638-b30f-4f69-a500-ee0fff2ad7f6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:29.056214 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-111ca638-b30f-4f69-a500-ee0fff2ad7f6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:29.197265 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-111ca638-b30f-4f69-a500-ee0fff2ad7f6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:29.205297 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-111ca638-b30f-4f69-a500-ee0fff2ad7f6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1679 microversion: 2.1 time: 0.162920 Apr 11 16:42:29.205872 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 337/689] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:29 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:30.223135 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-85137c23-f7cf-47fe-81f4-525a79159ca5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:30.223702 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-85137c23-f7cf-47fe-81f4-525a79159ca5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:30.230868 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-85137c23-f7cf-47fe-81f4-525a79159ca5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:30.231332 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-85137c23-f7cf-47fe-81f4-525a79159ca5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:30.232110 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-85137c23-f7cf-47fe-81f4-525a79159ca5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:30.232553 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-85137c23-f7cf-47fe-81f4-525a79159ca5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:30.378662 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-85137c23-f7cf-47fe-81f4-525a79159ca5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:30.387449 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-85137c23-f7cf-47fe-81f4-525a79159ca5 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1656 microversion: 2.1 time: 0.168334 Apr 11 16:42:30.388055 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 353/690] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:30 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1656 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:30.412158 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-41edc45e-5a6b-4d49-9171-40e14a56189b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:42:30.418659 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-41edc45e-5a6b-4d49-9171-40e14a56189b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:30.419099 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-41edc45e-5a6b-4d49-9171-40e14a56189b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:30.442518 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-41edc45e-5a6b-4d49-9171-40e14a56189b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Going to try to start instance {{(pid=123774) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 11 16:42:30.488181 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-41edc45e-5a6b-4d49-9171-40e14a56189b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "POST /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768/action" status: 202 len: 0 microversion: 2.1 time: 0.081736 Apr 11 16:42:30.489126 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 338/691] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Apr 11 16:42:30 2022] POST /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:42:30.497991 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b520a538-f3d3-44ee-bfab-f7e3ac181e3e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:30.498632 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b520a538-f3d3-44ee-bfab-f7e3ac181e3e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:30.505639 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b520a538-f3d3-44ee-bfab-f7e3ac181e3e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:30.506215 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b520a538-f3d3-44ee-bfab-f7e3ac181e3e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:30.506945 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b520a538-f3d3-44ee-bfab-f7e3ac181e3e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:30.507388 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b520a538-f3d3-44ee-bfab-f7e3ac181e3e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:30.649701 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b520a538-f3d3-44ee-bfab-f7e3ac181e3e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:30.658053 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b520a538-f3d3-44ee-bfab-f7e3ac181e3e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1665 microversion: 2.1 time: 0.164169 Apr 11 16:42:30.658668 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 354/692] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:30 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1665 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:31.677610 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-4a09076a-37af-4f6f-a04e-dcfaa4cd79b7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:31.678464 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-4a09076a-37af-4f6f-a04e-dcfaa4cd79b7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:31.685299 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4a09076a-37af-4f6f-a04e-dcfaa4cd79b7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:31.685738 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4a09076a-37af-4f6f-a04e-dcfaa4cd79b7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:31.686502 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4a09076a-37af-4f6f-a04e-dcfaa4cd79b7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:31.686930 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4a09076a-37af-4f6f-a04e-dcfaa4cd79b7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:31.823937 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-4a09076a-37af-4f6f-a04e-dcfaa4cd79b7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:31.831957 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-4a09076a-37af-4f6f-a04e-dcfaa4cd79b7 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1665 microversion: 2.1 time: 0.158661 Apr 11 16:42:31.832571 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 339/693] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:31 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:32.849615 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-aca02f35-002e-43cf-bb00-8bea5958c333 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:32.850168 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-aca02f35-002e-43cf-bb00-8bea5958c333 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:32.857122 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-aca02f35-002e-43cf-bb00-8bea5958c333 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:32.857563 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-aca02f35-002e-43cf-bb00-8bea5958c333 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:32.858324 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-aca02f35-002e-43cf-bb00-8bea5958c333 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:32.858738 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-aca02f35-002e-43cf-bb00-8bea5958c333 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:32.995053 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-aca02f35-002e-43cf-bb00-8bea5958c333 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:33.003556 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-aca02f35-002e-43cf-bb00-8bea5958c333 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1665 microversion: 2.1 time: 0.158335 Apr 11 16:42:33.004181 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 355/694] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:32 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:34.021658 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-678e75ea-4df9-41f4-a3e7-7ee0d62d8eeb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:34.022270 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-678e75ea-4df9-41f4-a3e7-7ee0d62d8eeb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:34.029257 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-678e75ea-4df9-41f4-a3e7-7ee0d62d8eeb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:34.029699 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-678e75ea-4df9-41f4-a3e7-7ee0d62d8eeb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:34.030674 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-678e75ea-4df9-41f4-a3e7-7ee0d62d8eeb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:34.031271 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-678e75ea-4df9-41f4-a3e7-7ee0d62d8eeb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:34.170888 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-678e75ea-4df9-41f4-a3e7-7ee0d62d8eeb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:34.179294 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-678e75ea-4df9-41f4-a3e7-7ee0d62d8eeb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1665 microversion: 2.1 time: 0.161561 Apr 11 16:42:34.180022 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 340/695] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:34 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1665 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:35.198649 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-6a44ed19-2e80-4662-992d-fc3d984c87d0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:35.199290 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-6a44ed19-2e80-4662-992d-fc3d984c87d0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:35.206384 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6a44ed19-2e80-4662-992d-fc3d984c87d0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:35.206830 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6a44ed19-2e80-4662-992d-fc3d984c87d0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:35.207672 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6a44ed19-2e80-4662-992d-fc3d984c87d0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:35.208030 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6a44ed19-2e80-4662-992d-fc3d984c87d0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:35.339423 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6a44ed19-2e80-4662-992d-fc3d984c87d0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:35.347919 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-6a44ed19-2e80-4662-992d-fc3d984c87d0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1665 microversion: 2.1 time: 0.154358 Apr 11 16:42:35.348711 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 356/696] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:35 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:36.365823 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c5c6e70f-c8a1-4479-a54e-7cdcbd190afa tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:36.366456 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c5c6e70f-c8a1-4479-a54e-7cdcbd190afa tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:36.373757 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c5c6e70f-c8a1-4479-a54e-7cdcbd190afa tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:36.374204 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c5c6e70f-c8a1-4479-a54e-7cdcbd190afa tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:36.375037 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c5c6e70f-c8a1-4479-a54e-7cdcbd190afa tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:36.375466 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c5c6e70f-c8a1-4479-a54e-7cdcbd190afa tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:36.519600 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c5c6e70f-c8a1-4479-a54e-7cdcbd190afa tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:36.528884 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c5c6e70f-c8a1-4479-a54e-7cdcbd190afa tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1669 microversion: 2.1 time: 0.166980 Apr 11 16:42:36.540620 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 341/697] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:42:36 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1669 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:48.299017 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b40d68dd-53c5-488a-991d-9bce65d65b73 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:48.299617 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b40d68dd-53c5-488a-991d-9bce65d65b73 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:48.306362 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b40d68dd-53c5-488a-991d-9bce65d65b73 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:48.306812 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b40d68dd-53c5-488a-991d-9bce65d65b73 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:48.307571 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b40d68dd-53c5-488a-991d-9bce65d65b73 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:48.308024 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b40d68dd-53c5-488a-991d-9bce65d65b73 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:48.344205 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b40d68dd-53c5-488a-991d-9bce65d65b73 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a/os-volume_attachments/8700b053-f73e-4d5a-ad7a-5cae9c23f612" status: 200 len: 194 microversion: 2.20 time: 0.049159 Apr 11 16:42:48.344972 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 357/698] 10.222.0.65 () {60 vars in 1453 bytes} [Mon Apr 11 16:42:48 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a/os-volume_attachments/8700b053-f73e-4d5a-ad7a-5cae9c23f612 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:42:48.412231 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-457cb6e4-ecc5-49d6-b064-0a8fc25f4b30 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:48.412943 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-457cb6e4-ecc5-49d6-b064-0a8fc25f4b30 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:48.420092 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-457cb6e4-ecc5-49d6-b064-0a8fc25f4b30 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:48.420542 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-457cb6e4-ecc5-49d6-b064-0a8fc25f4b30 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:48.421299 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-457cb6e4-ecc5-49d6-b064-0a8fc25f4b30 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:48.421728 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-457cb6e4-ecc5-49d6-b064-0a8fc25f4b30 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:48.501190 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.objects.instance [None req-457cb6e4-ecc5-49d6-b064-0a8fc25f4b30 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lazy-loading 'services' on Instance uuid f08685e5-3c41-4032-9633-cc591711221a {{(pid=123774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:42:48.571608 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-457cb6e4-ecc5-49d6-b064-0a8fc25f4b30 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a/os-volume_attachments/8700b053-f73e-4d5a-ad7a-5cae9c23f612" status: 202 len: 0 microversion: 2.20 time: 0.163263 Apr 11 16:42:48.572281 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 342/699] 10.222.0.65 () {60 vars in 1456 bytes} [Mon Apr 11 16:42:48 2022] DELETE /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a/os-volume_attachments/8700b053-f73e-4d5a-ad7a-5cae9c23f612 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:42:48.580740 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-a7595111-d57b-4387-9ad5-2dd85cd8beb3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:48.581728 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-a7595111-d57b-4387-9ad5-2dd85cd8beb3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:48.588212 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a7595111-d57b-4387-9ad5-2dd85cd8beb3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:48.588734 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a7595111-d57b-4387-9ad5-2dd85cd8beb3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:48.589433 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a7595111-d57b-4387-9ad5-2dd85cd8beb3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:48.589866 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a7595111-d57b-4387-9ad5-2dd85cd8beb3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:48.621771 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-a7595111-d57b-4387-9ad5-2dd85cd8beb3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044994 Apr 11 16:42:48.622390 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 358/700] 10.222.0.65 () {60 vars in 1342 bytes} [Mon Apr 11 16:42:48 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:42:49.634681 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5d06246f-b368-4bf0-b200-a05f9fe912ad tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:49.635792 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5d06246f-b368-4bf0-b200-a05f9fe912ad tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:49.642590 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5d06246f-b368-4bf0-b200-a05f9fe912ad tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:49.643030 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5d06246f-b368-4bf0-b200-a05f9fe912ad tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:49.643807 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5d06246f-b368-4bf0-b200-a05f9fe912ad tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:49.644264 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5d06246f-b368-4bf0-b200-a05f9fe912ad tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:49.674687 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5d06246f-b368-4bf0-b200-a05f9fe912ad tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045213 Apr 11 16:42:49.675251 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 343/701] 10.222.0.65 () {60 vars in 1342 bytes} [Mon Apr 11 16:42:49 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:42:49.733046 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-cad2df60-d904-4c0f-8ef4-3d9ac1b36956 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:49.733589 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-cad2df60-d904-4c0f-8ef4-3d9ac1b36956 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:49.740267 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cad2df60-d904-4c0f-8ef4-3d9ac1b36956 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:49.740795 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cad2df60-d904-4c0f-8ef4-3d9ac1b36956 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:49.741548 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cad2df60-d904-4c0f-8ef4-3d9ac1b36956 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:49.741972 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cad2df60-d904-4c0f-8ef4-3d9ac1b36956 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:49.766955 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-cad2df60-d904-4c0f-8ef4-3d9ac1b36956 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Going to try to terminate instance {{(pid=123773) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:42:49.850007 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-cad2df60-d904-4c0f-8ef4-3d9ac1b36956 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 204 len: 0 microversion: 2.20 time: 0.120179 Apr 11 16:42:49.850791 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 359/702] 10.222.0.65 () {60 vars in 1279 bytes} [Mon Apr 11 16:42:49 2022] DELETE /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 16:42:49.859483 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-1a52608f-3c43-4ead-8113-e2ad9caedac6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:49.860262 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-1a52608f-3c43-4ead-8113-e2ad9caedac6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:49.866549 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1a52608f-3c43-4ead-8113-e2ad9caedac6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:49.866991 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1a52608f-3c43-4ead-8113-e2ad9caedac6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:49.867782 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1a52608f-3c43-4ead-8113-e2ad9caedac6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:49.868211 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1a52608f-3c43-4ead-8113-e2ad9caedac6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:50.005542 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-1a52608f-3c43-4ead-8113-e2ad9caedac6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:50.014408 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-1a52608f-3c43-4ead-8113-e2ad9caedac6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:50.015963 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-1a52608f-3c43-4ead-8113-e2ad9caedac6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:50.017140 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-1a52608f-3c43-4ead-8113-e2ad9caedac6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1721 microversion: 2.20 time: 0.161740 Apr 11 16:42:50.017711 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 344/703] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:42:49 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:42:51.037295 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-018884d0-1fc9-4204-aa01-3020c6ecbf8b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:51.037979 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-018884d0-1fc9-4204-aa01-3020c6ecbf8b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:51.044972 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-018884d0-1fc9-4204-aa01-3020c6ecbf8b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:51.045414 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-018884d0-1fc9-4204-aa01-3020c6ecbf8b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:51.046187 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-018884d0-1fc9-4204-aa01-3020c6ecbf8b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:51.046610 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-018884d0-1fc9-4204-aa01-3020c6ecbf8b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:51.177310 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-018884d0-1fc9-4204-aa01-3020c6ecbf8b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:51.185818 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-018884d0-1fc9-4204-aa01-3020c6ecbf8b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:51.187289 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-018884d0-1fc9-4204-aa01-3020c6ecbf8b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:51.188465 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-018884d0-1fc9-4204-aa01-3020c6ecbf8b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1721 microversion: 2.20 time: 0.155594 Apr 11 16:42:51.188995 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 360/704] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:42:51 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:42:52.206919 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-bd2d8d75-eaf9-4bda-9719-d5adb9a0c0e7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:52.207496 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-bd2d8d75-eaf9-4bda-9719-d5adb9a0c0e7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:52.215017 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bd2d8d75-eaf9-4bda-9719-d5adb9a0c0e7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:52.215455 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bd2d8d75-eaf9-4bda-9719-d5adb9a0c0e7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:52.216254 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bd2d8d75-eaf9-4bda-9719-d5adb9a0c0e7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:52.216679 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bd2d8d75-eaf9-4bda-9719-d5adb9a0c0e7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:52.355929 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-bd2d8d75-eaf9-4bda-9719-d5adb9a0c0e7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:52.366859 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-bd2d8d75-eaf9-4bda-9719-d5adb9a0c0e7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:52.368376 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-bd2d8d75-eaf9-4bda-9719-d5adb9a0c0e7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:52.369542 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-bd2d8d75-eaf9-4bda-9719-d5adb9a0c0e7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1721 microversion: 2.20 time: 0.166638 Apr 11 16:42:52.370114 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 345/705] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:42:52 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:42:52.938199 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-422177be-e415-433b-9c49-f06bb61c52b6 req-cea8492a-9b37-41b8-91d6-725ae3d78422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08685e5-3c41-4032-9633-cc591711221a", "name": "network-vif-deleted", "tag": "8b85453b-0363-47d5-9902-93d848d7263e"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:42:52.948125 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-422177be-e415-433b-9c49-f06bb61c52b6 req-cea8492a-9b37-41b8-91d6-725ae3d78422 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:52.948575 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-422177be-e415-433b-9c49-f06bb61c52b6 req-cea8492a-9b37-41b8-91d6-725ae3d78422 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:52.969257 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-422177be-e415-433b-9c49-f06bb61c52b6 req-cea8492a-9b37-41b8-91d6-725ae3d78422 service nova] Creating event network-vif-deleted:8b85453b-0363-47d5-9902-93d848d7263e for instance f08685e5-3c41-4032-9633-cc591711221a on hv-cinder-83716 Apr 11 16:42:52.975065 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-422177be-e415-433b-9c49-f06bb61c52b6 req-cea8492a-9b37-41b8-91d6-725ae3d78422 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041101 Apr 11 16:42:52.975893 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 361/706] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:42:53.390973 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e13dde99-7782-4c00-afc3-f57602e34cc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:53.392702 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e13dde99-7782-4c00-afc3-f57602e34cc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:53.400441 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e13dde99-7782-4c00-afc3-f57602e34cc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:53.401288 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e13dde99-7782-4c00-afc3-f57602e34cc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:53.402441 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e13dde99-7782-4c00-afc3-f57602e34cc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:53.403086 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e13dde99-7782-4c00-afc3-f57602e34cc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:53.436399 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e13dde99-7782-4c00-afc3-f57602e34cc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:53.437221 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e13dde99-7782-4c00-afc3-f57602e34cc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:53.437969 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.objects.instance [None req-e13dde99-7782-4c00-afc3-f57602e34cc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lazy-loading 'fault' on Instance uuid f08685e5-3c41-4032-9633-cc591711221a {{(pid=123774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:42:53.482895 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e13dde99-7782-4c00-afc3-f57602e34cc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:53.492967 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e13dde99-7782-4c00-afc3-f57602e34cc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:53.494204 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e13dde99-7782-4c00-afc3-f57602e34cc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:53.495835 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e13dde99-7782-4c00-afc3-f57602e34cc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 200 len: 1370 microversion: 2.20 time: 0.110278 Apr 11 16:42:53.496328 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 346/707] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:42:53 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 1370 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:42:54.515435 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-28e5d131-5d6e-4eb4-a0c7-5b3b1d06940b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:54.516132 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-28e5d131-5d6e-4eb4-a0c7-5b3b1d06940b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:54.523401 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-28e5d131-5d6e-4eb4-a0c7-5b3b1d06940b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:54.523884 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-28e5d131-5d6e-4eb4-a0c7-5b3b1d06940b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:54.524655 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-28e5d131-5d6e-4eb4-a0c7-5b3b1d06940b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:54.525090 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-28e5d131-5d6e-4eb4-a0c7-5b3b1d06940b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:54.538791 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-28e5d131-5d6e-4eb4-a0c7-5b3b1d06940b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] HTTP exception thrown: Instance f08685e5-3c41-4032-9633-cc591711221a could not be found. Apr 11 16:42:54.539418 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-28e5d131-5d6e-4eb4-a0c7-5b3b1d06940b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Returning 404 to user: Instance f08685e5-3c41-4032-9633-cc591711221a could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:42:54.540308 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-28e5d131-5d6e-4eb4-a0c7-5b3b1d06940b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 404 len: 111 microversion: 2.20 time: 0.029794 Apr 11 16:42:54.540867 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 362/708] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:42:54 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 16:42:54.549758 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-949400d0-58a4-4cdb-9d66-d52cbb5bbe4c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '.version_select at 0x7f74181d5a60>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:54.574365 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-949400d0-58a4-4cdb-9d66-d52cbb5bbe4c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-99754670" status: 204 len: 0 microversion: 2.20 time: 0.028677 Apr 11 16:42:54.575006 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 347/709] 10.222.0.65 () {60 vars in 1255 bytes} [Mon Apr 11 16:42:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-99754670 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 16:42:55.494965 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-00450121-3894-4a4f-be8d-2da26cad3e55 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Action: 'create', calling method: .version_select at 0x7f741807cc10>, body: {"keypair": {"name": "tempest-keypair-1143621005"}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:42:55.511599 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-00450121-3894-4a4f-be8d-2da26cad3e55 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Getting quotas for project fff5d5c8db254085a82ca911ead15f49. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:42:55.516580 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-00450121-3894-4a4f-be8d-2da26cad3e55 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Getting quotas for user 98902ced574b44779b9aec59a2f999fb and project fff5d5c8db254085a82ca911ead15f49. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:42:55.719051 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-00450121-3894-4a4f-be8d-2da26cad3e55 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Getting quotas for project fff5d5c8db254085a82ca911ead15f49. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:42:55.722948 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-00450121-3894-4a4f-be8d-2da26cad3e55 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Getting quotas for user 98902ced574b44779b9aec59a2f999fb and project fff5d5c8db254085a82ca911ead15f49. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:42:55.737709 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-00450121-3894-4a4f-be8d-2da26cad3e55 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.246583 Apr 11 16:42:55.738646 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 363/710] 10.222.0.65 () {62 vars in 1198 bytes} [Mon Apr 11 16:42:55 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 248 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 11 16:42:57.013401 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-0da101bb-5388-44bc-b247-21db76832e0c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-371428950", "imageRef": "e989c938-7b7a-445c-aec9-596e81d35104", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4bfaa63-8897-444c-b3cb-093694071bc5"}], "security_groups": [{"name": "tempest-securitygroup--2013405029"}], "key_name": "tempest-keypair-1143621005", "user_data": "}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:42:57.120763 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.network.neutron [None req-0da101bb-5388-44bc-b247-21db76832e0c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] validate_networks() for [('f4bfaa63-8897-444c-b3cb-093694071bc5', None, None, None, None, None)] {{(pid=123774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:42:57.585331 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-0da101bb-5388-44bc-b247-21db76832e0c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Flavor limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:42:57.585748 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-0da101bb-5388-44bc-b247-21db76832e0c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Image limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:42:57.586217 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-0da101bb-5388-44bc-b247-21db76832e0c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Flavor pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:42:57.586614 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-0da101bb-5388-44bc-b247-21db76832e0c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Image pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:42:57.587013 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-0da101bb-5388-44bc-b247-21db76832e0c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:42:57.596850 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0da101bb-5388-44bc-b247-21db76832e0c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:57.597290 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0da101bb-5388-44bc-b247-21db76832e0c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:57.598107 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0da101bb-5388-44bc-b247-21db76832e0c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:42:57.598532 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0da101bb-5388-44bc-b247-21db76832e0c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:42:57.615678 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-0da101bb-5388-44bc-b247-21db76832e0c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Getting quotas for project fff5d5c8db254085a82ca911ead15f49. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:42:57.619770 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-0da101bb-5388-44bc-b247-21db76832e0c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Getting quotas for user 98902ced574b44779b9aec59a2f999fb and project fff5d5c8db254085a82ca911ead15f49. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:42:57.632563 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-0da101bb-5388-44bc-b247-21db76832e0c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Going to run 1 instances... {{(pid=123774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:42:57.634834 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-0da101bb-5388-44bc-b247-21db76832e0c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e989c938-7b7a-445c-aec9-596e81d35104',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:42:57.685070 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0da101bb-5388-44bc-b247-21db76832e0c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [f04b7b86-6245-45ca-9742-98d2000d17f2] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 16:42:58.694470 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO oslo.messaging._drivers.impl_rabbit [None req-0da101bb-5388-44bc-b247-21db76832e0c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [f04b7b86-6245-45ca-9742-98d2000d17f2] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 33756. Apr 11 16:42:58.700156 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-0da101bb-5388-44bc-b247-21db76832e0c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.691700 Apr 11 16:42:58.700824 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 348/711] 10.222.0.65 () {62 vars in 1187 bytes} [Mon Apr 11 16:42:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 1693 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 11 16:42:58.711809 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-7544e24f-ad9e-4d4f-8cac-565e66ff631c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:58.712426 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-7544e24f-ad9e-4d4f-8cac-565e66ff631c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:58.770520 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-7544e24f-ad9e-4d4f-8cac-565e66ff631c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:58.779764 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-7544e24f-ad9e-4d4f-8cac-565e66ff631c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:58.782044 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-7544e24f-ad9e-4d4f-8cac-565e66ff631c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:58.783170 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-7544e24f-ad9e-4d4f-8cac-565e66ff631c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1281 microversion: 2.20 time: 0.075922 Apr 11 16:42:58.783745 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 364/712] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:42:58 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:42:59.805098 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-8ded5eb5-f52c-4355-bb3a-aeac880a9d3a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:42:59.805699 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-8ded5eb5-f52c-4355-bb3a-aeac880a9d3a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:42:59.859656 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8ded5eb5-f52c-4355-bb3a-aeac880a9d3a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:59.866973 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8ded5eb5-f52c-4355-bb3a-aeac880a9d3a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:59.868492 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8ded5eb5-f52c-4355-bb3a-aeac880a9d3a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:42:59.869587 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-8ded5eb5-f52c-4355-bb3a-aeac880a9d3a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1281 microversion: 2.20 time: 0.071139 Apr 11 16:42:59.870174 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 349/713] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:42:59 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:43:00.892794 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-689a80b2-ea6a-482c-94f7-00aa8c8290d7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:00.893535 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-689a80b2-ea6a-482c-94f7-00aa8c8290d7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:00.948920 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-689a80b2-ea6a-482c-94f7-00aa8c8290d7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:00.956444 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-689a80b2-ea6a-482c-94f7-00aa8c8290d7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:00.957919 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-689a80b2-ea6a-482c-94f7-00aa8c8290d7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:00.959113 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-689a80b2-ea6a-482c-94f7-00aa8c8290d7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1281 microversion: 2.20 time: 0.070204 Apr 11 16:43:00.959672 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 365/714] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:43:00 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:43:01.274443 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-0a38b85a-0fc5-430b-800f-eb87e9bfa569 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:01.274987 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-0a38b85a-0fc5-430b-800f-eb87e9bfa569 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:01.282123 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0a38b85a-0fc5-430b-800f-eb87e9bfa569 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:01.282563 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0a38b85a-0fc5-430b-800f-eb87e9bfa569 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:01.283309 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0a38b85a-0fc5-430b-800f-eb87e9bfa569 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:01.283770 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0a38b85a-0fc5-430b-800f-eb87e9bfa569 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:01.364827 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.objects.instance [None req-0a38b85a-0fc5-430b-800f-eb87e9bfa569 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lazy-loading 'services' on Instance uuid 2b8c15a9-44fe-41af-affd-6ea36d214007 {{(pid=123774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:43:01.440178 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-0a38b85a-0fc5-430b-800f-eb87e9bfa569 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007/os-volume_attachments/6c6b71eb-3344-4a0e-8bb2-98e196d4b5ed" status: 202 len: 0 microversion: 2.1 time: 0.169723 Apr 11 16:43:01.440863 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 350/715] 10.222.0.65 () {58 vars in 1415 bytes} [Mon Apr 11 16:43:01 2022] DELETE /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007/os-volume_attachments/6c6b71eb-3344-4a0e-8bb2-98e196d4b5ed => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:43:01.449727 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-a42a368b-6c4d-4ba5-8490-99403c5cd988 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:01.450655 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-a42a368b-6c4d-4ba5-8490-99403c5cd988 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:01.457616 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a42a368b-6c4d-4ba5-8490-99403c5cd988 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:01.458108 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a42a368b-6c4d-4ba5-8490-99403c5cd988 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:01.459061 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a42a368b-6c4d-4ba5-8490-99403c5cd988 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:01.459724 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a42a368b-6c4d-4ba5-8490-99403c5cd988 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:01.491510 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-a42a368b-6c4d-4ba5-8490-99403c5cd988 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045716 Apr 11 16:43:01.492096 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 366/716] 10.222.0.65 () {58 vars in 1301 bytes} [Mon Apr 11 16:43:01 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:43:01.978360 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5f74fd50-2d6f-4bfe-8a03-c8d6dd6ee911 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:01.979009 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5f74fd50-2d6f-4bfe-8a03-c8d6dd6ee911 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:02.041681 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5f74fd50-2d6f-4bfe-8a03-c8d6dd6ee911 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:02.048223 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5f74fd50-2d6f-4bfe-8a03-c8d6dd6ee911 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:02.050791 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5f74fd50-2d6f-4bfe-8a03-c8d6dd6ee911 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:02.052212 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5f74fd50-2d6f-4bfe-8a03-c8d6dd6ee911 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1281 microversion: 2.20 time: 0.079195 Apr 11 16:43:02.053082 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 351/717] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:43:01 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:43:02.508126 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d9ef9cf4-3257-4614-8bc5-b72415c420d6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:02.509060 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d9ef9cf4-3257-4614-8bc5-b72415c420d6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:02.515877 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d9ef9cf4-3257-4614-8bc5-b72415c420d6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:02.516329 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d9ef9cf4-3257-4614-8bc5-b72415c420d6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:02.517130 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d9ef9cf4-3257-4614-8bc5-b72415c420d6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:02.517569 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d9ef9cf4-3257-4614-8bc5-b72415c420d6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:02.546982 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d9ef9cf4-3257-4614-8bc5-b72415c420d6 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044413 Apr 11 16:43:02.547543 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 367/718] 10.222.0.65 () {58 vars in 1301 bytes} [Mon Apr 11 16:43:02 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 16:43:02.617686 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-4682b408-d180-428d-84ce-9d827f51a94b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:02.618237 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-4682b408-d180-428d-84ce-9d827f51a94b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:02.626014 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4682b408-d180-428d-84ce-9d827f51a94b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:02.626463 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4682b408-d180-428d-84ce-9d827f51a94b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:02.627248 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4682b408-d180-428d-84ce-9d827f51a94b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:02.627709 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4682b408-d180-428d-84ce-9d827f51a94b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:02.654827 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-4682b408-d180-428d-84ce-9d827f51a94b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Going to try to terminate instance {{(pid=123774) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:43:02.742282 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-4682b408-d180-428d-84ce-9d827f51a94b tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 204 len: 0 microversion: 2.1 time: 0.128520 Apr 11 16:43:02.743472 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 352/719] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:43:02 2022] DELETE /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:43:02.759927 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-a9eecd05-c612-4047-81fa-28617014cf9a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:02.761114 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-a9eecd05-c612-4047-81fa-28617014cf9a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:02.775869 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a9eecd05-c612-4047-81fa-28617014cf9a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:02.777101 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a9eecd05-c612-4047-81fa-28617014cf9a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:02.778524 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a9eecd05-c612-4047-81fa-28617014cf9a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:02.779533 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a9eecd05-c612-4047-81fa-28617014cf9a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:02.935653 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-a9eecd05-c612-4047-81fa-28617014cf9a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:02.943782 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-a9eecd05-c612-4047-81fa-28617014cf9a tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1690 microversion: 2.1 time: 0.195474 Apr 11 16:43:02.944368 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 368/720] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:02 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1690 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:03.070773 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-933eef02-2c58-448d-94e7-11e80f2aa7db tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:03.071469 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-933eef02-2c58-448d-94e7-11e80f2aa7db tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:03.078065 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-933eef02-2c58-448d-94e7-11e80f2aa7db tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:03.078514 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-933eef02-2c58-448d-94e7-11e80f2aa7db tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:03.079284 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-933eef02-2c58-448d-94e7-11e80f2aa7db tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:03.079783 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-933eef02-2c58-448d-94e7-11e80f2aa7db tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:03.143791 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-933eef02-2c58-448d-94e7-11e80f2aa7db tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:03.152606 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-933eef02-2c58-448d-94e7-11e80f2aa7db tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:03.154106 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-933eef02-2c58-448d-94e7-11e80f2aa7db tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:03.155252 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-933eef02-2c58-448d-94e7-11e80f2aa7db tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1351 microversion: 2.20 time: 0.089513 Apr 11 16:43:03.155859 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 353/721] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:43:03 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1351 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:43:03.960869 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d79deb9e-bf04-413c-b943-c751abf6da4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:03.961599 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d79deb9e-bf04-413c-b943-c751abf6da4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:03.968328 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d79deb9e-bf04-413c-b943-c751abf6da4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:03.968776 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d79deb9e-bf04-413c-b943-c751abf6da4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:03.969524 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d79deb9e-bf04-413c-b943-c751abf6da4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:03.969980 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d79deb9e-bf04-413c-b943-c751abf6da4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:04.106989 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d79deb9e-bf04-413c-b943-c751abf6da4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:04.117249 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d79deb9e-bf04-413c-b943-c751abf6da4d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1690 microversion: 2.1 time: 0.160354 Apr 11 16:43:04.117853 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 369/722] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:03 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:04.174125 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-fea679a5-06e1-4b22-8604-f9d52e052891 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:04.174822 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-fea679a5-06e1-4b22-8604-f9d52e052891 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:04.181964 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fea679a5-06e1-4b22-8604-f9d52e052891 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:04.182412 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fea679a5-06e1-4b22-8604-f9d52e052891 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:04.183204 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fea679a5-06e1-4b22-8604-f9d52e052891 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:04.183677 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fea679a5-06e1-4b22-8604-f9d52e052891 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:04.252688 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-fea679a5-06e1-4b22-8604-f9d52e052891 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:04.261062 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-fea679a5-06e1-4b22-8604-f9d52e052891 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:04.262548 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-fea679a5-06e1-4b22-8604-f9d52e052891 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:04.263687 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-fea679a5-06e1-4b22-8604-f9d52e052891 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1351 microversion: 2.20 time: 0.093578 Apr 11 16:43:04.264268 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 354/723] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:43:04 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:43:05.135362 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ffaa66fa-b12b-4168-9116-553bc88ca182 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:05.136012 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ffaa66fa-b12b-4168-9116-553bc88ca182 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:05.142699 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ffaa66fa-b12b-4168-9116-553bc88ca182 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:05.143142 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ffaa66fa-b12b-4168-9116-553bc88ca182 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:05.143943 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ffaa66fa-b12b-4168-9116-553bc88ca182 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:05.144370 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ffaa66fa-b12b-4168-9116-553bc88ca182 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:05.278633 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ffaa66fa-b12b-4168-9116-553bc88ca182 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:05.281897 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-0c148ae0-6060-4fb6-8e75-527e13ab1fce tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:05.282563 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-0c148ae0-6060-4fb6-8e75-527e13ab1fce tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:05.286629 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ffaa66fa-b12b-4168-9116-553bc88ca182 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1690 microversion: 2.1 time: 0.155079 Apr 11 16:43:05.287357 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 370/724] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:05 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:05.289565 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0c148ae0-6060-4fb6-8e75-527e13ab1fce tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:05.290007 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0c148ae0-6060-4fb6-8e75-527e13ab1fce tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:05.290885 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0c148ae0-6060-4fb6-8e75-527e13ab1fce tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:05.291319 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0c148ae0-6060-4fb6-8e75-527e13ab1fce tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:05.353354 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0c148ae0-6060-4fb6-8e75-527e13ab1fce tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:05.361664 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0c148ae0-6060-4fb6-8e75-527e13ab1fce tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:05.363201 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0c148ae0-6060-4fb6-8e75-527e13ab1fce tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:05.364353 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-0c148ae0-6060-4fb6-8e75-527e13ab1fce tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1351 microversion: 2.20 time: 0.086475 Apr 11 16:43:05.364918 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 355/725] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:43:05 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1351 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:43:06.304731 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-0fac7abd-202a-4832-82f7-9a1d4c3e3e24 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:06.305371 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-0fac7abd-202a-4832-82f7-9a1d4c3e3e24 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:06.312230 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0fac7abd-202a-4832-82f7-9a1d4c3e3e24 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:06.312658 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0fac7abd-202a-4832-82f7-9a1d4c3e3e24 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:06.313698 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0fac7abd-202a-4832-82f7-9a1d4c3e3e24 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:06.314131 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0fac7abd-202a-4832-82f7-9a1d4c3e3e24 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:06.383848 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-aa052c0a-e392-4b8a-9ced-ae15bb81337e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:06.384499 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-aa052c0a-e392-4b8a-9ced-ae15bb81337e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:06.395324 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-aa052c0a-e392-4b8a-9ced-ae15bb81337e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:06.396681 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-aa052c0a-e392-4b8a-9ced-ae15bb81337e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:06.397026 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-aa052c0a-e392-4b8a-9ced-ae15bb81337e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:06.397467 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-aa052c0a-e392-4b8a-9ced-ae15bb81337e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:06.649471 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-0fac7abd-202a-4832-82f7-9a1d4c3e3e24 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:06.658217 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-0fac7abd-202a-4832-82f7-9a1d4c3e3e24 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1690 microversion: 2.1 time: 0.358330 Apr 11 16:43:06.659443 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 371/726] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:06 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1690 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:07.000892 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-aa052c0a-e392-4b8a-9ced-ae15bb81337e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:07.020215 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-aa052c0a-e392-4b8a-9ced-ae15bb81337e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:07.021780 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-aa052c0a-e392-4b8a-9ced-ae15bb81337e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:07.023164 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-aa052c0a-e392-4b8a-9ced-ae15bb81337e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1407 microversion: 2.20 time: 0.643616 Apr 11 16:43:07.035938 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 356/727] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:43:06 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1407 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:43:07.205858 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-01dd1c75-efcb-4dcd-912d-2c5c47270f08 req-758f02fa-db20-47bd-8b61-6d16b3d9f1fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29dde975-c7d2-4621-9914-28ebf83c7285", "tag": "49b5ba7a-7f54-4acc-8206-d942c4884181"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:43:07.221445 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-01dd1c75-efcb-4dcd-912d-2c5c47270f08 req-758f02fa-db20-47bd-8b61-6d16b3d9f1fc service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:07.222315 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-01dd1c75-efcb-4dcd-912d-2c5c47270f08 req-758f02fa-db20-47bd-8b61-6d16b3d9f1fc service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:07.241326 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-01dd1c75-efcb-4dcd-912d-2c5c47270f08 req-758f02fa-db20-47bd-8b61-6d16b3d9f1fc service nova] Creating event network-changed:49b5ba7a-7f54-4acc-8206-d942c4884181 for instance 29dde975-c7d2-4621-9914-28ebf83c7285 on hv-cinder-83716 Apr 11 16:43:07.247285 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-01dd1c75-efcb-4dcd-912d-2c5c47270f08 req-758f02fa-db20-47bd-8b61-6d16b3d9f1fc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050701 Apr 11 16:43:07.248438 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 372/728] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:43:07.675994 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e2bbbbae-6cde-4382-8bbf-04c43eb8bf25 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:07.677201 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e2bbbbae-6cde-4382-8bbf-04c43eb8bf25 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:07.684551 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e2bbbbae-6cde-4382-8bbf-04c43eb8bf25 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:07.685332 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e2bbbbae-6cde-4382-8bbf-04c43eb8bf25 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:07.686193 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e2bbbbae-6cde-4382-8bbf-04c43eb8bf25 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:07.686720 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e2bbbbae-6cde-4382-8bbf-04c43eb8bf25 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:07.769981 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e2bbbbae-6cde-4382-8bbf-04c43eb8bf25 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:07.778346 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e2bbbbae-6cde-4382-8bbf-04c43eb8bf25 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1622 microversion: 2.1 time: 0.106348 Apr 11 16:43:07.782625 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 357/729] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:07 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1622 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:08.000839 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-5d42b33d-6dd2-46eb-a0b9-d0f7af352e7c req-a469d07e-b07b-4777-b86c-c53f126faa9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b8c15a9-44fe-41af-affd-6ea36d214007", "name": "network-vif-deleted", "tag": "851afbae-5cd1-4945-b6c6-66059ebc4234"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:43:08.010604 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-5d42b33d-6dd2-46eb-a0b9-d0f7af352e7c req-a469d07e-b07b-4777-b86c-c53f126faa9d service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:08.011009 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-5d42b33d-6dd2-46eb-a0b9-d0f7af352e7c req-a469d07e-b07b-4777-b86c-c53f126faa9d service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:08.030557 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-5d42b33d-6dd2-46eb-a0b9-d0f7af352e7c req-a469d07e-b07b-4777-b86c-c53f126faa9d service nova] Creating event network-vif-deleted:851afbae-5cd1-4945-b6c6-66059ebc4234 for instance 2b8c15a9-44fe-41af-affd-6ea36d214007 on hv-cinder-83716 Apr 11 16:43:08.045189 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-5d42b33d-6dd2-46eb-a0b9-d0f7af352e7c req-a469d07e-b07b-4777-b86c-c53f126faa9d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048303 Apr 11 16:43:08.046526 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-eca5547a-b047-4afe-ab45-20009039b6cb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:08.047608 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-eca5547a-b047-4afe-ab45-20009039b6cb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:08.048082 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 373/730] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:43:08.055404 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-eca5547a-b047-4afe-ab45-20009039b6cb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:08.056200 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-eca5547a-b047-4afe-ab45-20009039b6cb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:08.057038 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-eca5547a-b047-4afe-ab45-20009039b6cb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:08.057473 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-eca5547a-b047-4afe-ab45-20009039b6cb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:08.232461 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-eca5547a-b047-4afe-ab45-20009039b6cb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:08.241285 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-eca5547a-b047-4afe-ab45-20009039b6cb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:08.242761 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-eca5547a-b047-4afe-ab45-20009039b6cb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:08.244022 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-eca5547a-b047-4afe-ab45-20009039b6cb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1407 microversion: 2.20 time: 0.203966 Apr 11 16:43:08.244616 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 358/731] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:43:08 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:43:08.796855 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-cb8ce011-093a-4147-8923-f85115a49f72 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:08.797477 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-cb8ce011-093a-4147-8923-f85115a49f72 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:08.805564 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cb8ce011-093a-4147-8923-f85115a49f72 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:08.806026 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cb8ce011-093a-4147-8923-f85115a49f72 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:08.806772 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cb8ce011-093a-4147-8923-f85115a49f72 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:08.807229 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cb8ce011-093a-4147-8923-f85115a49f72 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:08.878611 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-cb8ce011-093a-4147-8923-f85115a49f72 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:08.888118 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-cb8ce011-093a-4147-8923-f85115a49f72 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1622 microversion: 2.1 time: 0.095955 Apr 11 16:43:08.888940 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 374/732] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:08 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1622 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:09.094070 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-387e6fda-76e9-4abf-899f-7a3a1d4e635e tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:43:09.095068 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-387e6fda-76e9-4abf-899f-7a3a1d4e635e tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:09.101819 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-387e6fda-76e9-4abf-899f-7a3a1d4e635e tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:09.102255 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-387e6fda-76e9-4abf-899f-7a3a1d4e635e tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:09.103048 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-387e6fda-76e9-4abf-899f-7a3a1d4e635e tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:09.103474 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-387e6fda-76e9-4abf-899f-7a3a1d4e635e tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:09.262866 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1b97dcd1-979a-424a-9b49-a7440e30c1c5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:09.263762 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1b97dcd1-979a-424a-9b49-a7440e30c1c5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:09.270245 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1b97dcd1-979a-424a-9b49-a7440e30c1c5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:09.270838 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1b97dcd1-979a-424a-9b49-a7440e30c1c5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:09.271779 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1b97dcd1-979a-424a-9b49-a7440e30c1c5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:09.272209 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1b97dcd1-979a-424a-9b49-a7440e30c1c5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:09.428712 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1b97dcd1-979a-424a-9b49-a7440e30c1c5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:09.441282 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1b97dcd1-979a-424a-9b49-a7440e30c1c5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:09.442891 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1b97dcd1-979a-424a-9b49-a7440e30c1c5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:09.444466 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1b97dcd1-979a-424a-9b49-a7440e30c1c5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1407 microversion: 2.20 time: 0.185753 Apr 11 16:43:09.445056 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 375/733] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:43:09 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:43:09.908992 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b6219595-0130-45a7-8d59-fe2b26b2dfa4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:09.909606 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b6219595-0130-45a7-8d59-fe2b26b2dfa4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:09.916429 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6219595-0130-45a7-8d59-fe2b26b2dfa4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:09.916876 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6219595-0130-45a7-8d59-fe2b26b2dfa4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:09.917671 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6219595-0130-45a7-8d59-fe2b26b2dfa4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:09.918096 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6219595-0130-45a7-8d59-fe2b26b2dfa4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:09.984995 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b6219595-0130-45a7-8d59-fe2b26b2dfa4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:09.994213 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b6219595-0130-45a7-8d59-fe2b26b2dfa4 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 200 len: 1622 microversion: 2.1 time: 0.089141 Apr 11 16:43:09.994842 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 376/734] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:09 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 1622 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:43:10.148626 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-387e6fda-76e9-4abf-899f-7a3a1d4e635e tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "POST /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad/action" status: 200 len: 14 microversion: 2.1 time: 1.271321 Apr 11 16:43:10.149308 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 359/735] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Apr 11 16:43:08 2022] POST /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad/action => generated 14 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 11 16:43:10.463141 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-9ca541d7-0f83-46e9-bb25-1e6760f39df0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:10.463765 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-9ca541d7-0f83-46e9-bb25-1e6760f39df0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:10.470669 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9ca541d7-0f83-46e9-bb25-1e6760f39df0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:10.471108 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9ca541d7-0f83-46e9-bb25-1e6760f39df0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:10.471932 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9ca541d7-0f83-46e9-bb25-1e6760f39df0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:10.472363 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9ca541d7-0f83-46e9-bb25-1e6760f39df0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:10.819186 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9ca541d7-0f83-46e9-bb25-1e6760f39df0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:10.830094 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9ca541d7-0f83-46e9-bb25-1e6760f39df0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:10.831709 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9ca541d7-0f83-46e9-bb25-1e6760f39df0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:10.833140 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-9ca541d7-0f83-46e9-bb25-1e6760f39df0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1407 microversion: 2.20 time: 0.374367 Apr 11 16:43:10.834106 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 377/736] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:43:10 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1407 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:43:11.012882 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ec0857b2-3953-4358-8c66-2187e1ae5019 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:11.013579 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ec0857b2-3953-4358-8c66-2187e1ae5019 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 2b8c15a9-44fe-41af-affd-6ea36d214007] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:11.020438 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ec0857b2-3953-4358-8c66-2187e1ae5019 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:11.021027 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ec0857b2-3953-4358-8c66-2187e1ae5019 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:11.021812 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ec0857b2-3953-4358-8c66-2187e1ae5019 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:11.022246 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ec0857b2-3953-4358-8c66-2187e1ae5019 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:11.038054 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-ec0857b2-3953-4358-8c66-2187e1ae5019 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] HTTP exception thrown: Instance 2b8c15a9-44fe-41af-affd-6ea36d214007 could not be found. Apr 11 16:43:11.038285 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ec0857b2-3953-4358-8c66-2187e1ae5019 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Returning 404 to user: Instance 2b8c15a9-44fe-41af-affd-6ea36d214007 could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:43:11.039134 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ec0857b2-3953-4358-8c66-2187e1ae5019 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007" status: 404 len: 111 microversion: 2.1 time: 0.030669 Apr 11 16:43:11.043017 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 360/737] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:11 2022] GET /compute/v2.1/servers/2b8c15a9-44fe-41af-affd-6ea36d214007 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:43:11.049641 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-33c168a2-b5d6-4b68-a68d-c5eb0574017e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '.version_select at 0x7f74181078b0>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:11.076061 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-33c168a2-b5d6-4b68-a68d-c5eb0574017e tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1405398358" status: 202 len: 0 microversion: 2.1 time: 0.030124 Apr 11 16:43:11.076674 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 378/738] 10.222.0.65 () {58 vars in 1220 bytes} [Mon Apr 11 16:43:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1405398358 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:43:11.747660 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-0b347592-3894-4ff0-a11c-1f5782701331 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:11.748731 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-0b347592-3894-4ff0-a11c-1f5782701331 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:11.752684 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-2cf630fa-b5e2-4c96-a770-b38fc3b76e35 req-f368dfd7-66b6-4405-b17c-05a8fa570679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cccd6eb0-741e-48d1-9539-108d80ff2cad", "tag": "a6f4f255-f8e2-4c79-9875-d58fd39df6bf"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:43:11.756201 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0b347592-3894-4ff0-a11c-1f5782701331 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:11.756730 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0b347592-3894-4ff0-a11c-1f5782701331 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:11.757574 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0b347592-3894-4ff0-a11c-1f5782701331 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:11.758233 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0b347592-3894-4ff0-a11c-1f5782701331 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:11.770666 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-2cf630fa-b5e2-4c96-a770-b38fc3b76e35 req-f368dfd7-66b6-4405-b17c-05a8fa570679 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:11.771403 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-2cf630fa-b5e2-4c96-a770-b38fc3b76e35 req-f368dfd7-66b6-4405-b17c-05a8fa570679 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:11.789044 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-2cf630fa-b5e2-4c96-a770-b38fc3b76e35 req-f368dfd7-66b6-4405-b17c-05a8fa570679 service nova] Creating event network-changed:a6f4f255-f8e2-4c79-9875-d58fd39df6bf for instance cccd6eb0-741e-48d1-9539-108d80ff2cad on hv-cinder-83716 Apr 11 16:43:11.790162 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-0b347592-3894-4ff0-a11c-1f5782701331 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Going to try to terminate instance {{(pid=123774) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:43:11.795363 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-2cf630fa-b5e2-4c96-a770-b38fc3b76e35 req-f368dfd7-66b6-4405-b17c-05a8fa570679 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046198 Apr 11 16:43:11.797525 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 379/739] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:43:11.854333 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b6bc5d55-adb9-4358-af13-04ae24ff7fab tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:11.855513 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b6bc5d55-adb9-4358-af13-04ae24ff7fab tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:11.863807 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6bc5d55-adb9-4358-af13-04ae24ff7fab tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:11.864487 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6bc5d55-adb9-4358-af13-04ae24ff7fab tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:11.865372 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6bc5d55-adb9-4358-af13-04ae24ff7fab tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:11.865805 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6bc5d55-adb9-4358-af13-04ae24ff7fab tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:11.927821 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-0b347592-3894-4ff0-a11c-1f5782701331 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "DELETE /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 204 len: 0 microversion: 2.1 time: 0.184008 Apr 11 16:43:11.929379 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 361/740] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:43:11 2022] DELETE /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:43:11.941096 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-3dbf02c3-eedb-4c9a-ab19-6343f4cd9f74 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:11.941799 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-3dbf02c3-eedb-4c9a-ab19-6343f4cd9f74 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:11.948964 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3dbf02c3-eedb-4c9a-ab19-6343f4cd9f74 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:11.949721 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3dbf02c3-eedb-4c9a-ab19-6343f4cd9f74 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:11.950570 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3dbf02c3-eedb-4c9a-ab19-6343f4cd9f74 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:11.951182 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3dbf02c3-eedb-4c9a-ab19-6343f4cd9f74 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:12.190014 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b6bc5d55-adb9-4358-af13-04ae24ff7fab tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:12.199378 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b6bc5d55-adb9-4358-af13-04ae24ff7fab tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:12.200897 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b6bc5d55-adb9-4358-af13-04ae24ff7fab tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:12.202019 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b6bc5d55-adb9-4358-af13-04ae24ff7fab tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1407 microversion: 2.20 time: 0.353695 Apr 11 16:43:12.202579 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 380/741] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:43:11 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1407 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:43:12.217465 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-3dbf02c3-eedb-4c9a-ab19-6343f4cd9f74 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:12.225750 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-3dbf02c3-eedb-4c9a-ab19-6343f4cd9f74 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1571 microversion: 2.1 time: 0.290810 Apr 11 16:43:12.226336 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 362/742] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:11 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1571 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:43:13.223465 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c97949b2-ee1d-4753-a7fe-5bed4b3b22b8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:13.225594 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c97949b2-ee1d-4753-a7fe-5bed4b3b22b8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:13.236356 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c97949b2-ee1d-4753-a7fe-5bed4b3b22b8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:13.236801 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c97949b2-ee1d-4753-a7fe-5bed4b3b22b8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:13.237844 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c97949b2-ee1d-4753-a7fe-5bed4b3b22b8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:13.238678 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c97949b2-ee1d-4753-a7fe-5bed4b3b22b8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:13.244736 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-8280d1e6-0288-4d94-9975-8174de2d8a1c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:13.245713 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-8280d1e6-0288-4d94-9975-8174de2d8a1c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:13.253474 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8280d1e6-0288-4d94-9975-8174de2d8a1c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:13.253928 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8280d1e6-0288-4d94-9975-8174de2d8a1c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:13.254707 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8280d1e6-0288-4d94-9975-8174de2d8a1c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:13.259595 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8280d1e6-0288-4d94-9975-8174de2d8a1c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:13.452327 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c97949b2-ee1d-4753-a7fe-5bed4b3b22b8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:13.462718 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c97949b2-ee1d-4753-a7fe-5bed4b3b22b8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:13.464565 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c97949b2-ee1d-4753-a7fe-5bed4b3b22b8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:13.466024 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c97949b2-ee1d-4753-a7fe-5bed4b3b22b8 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1407 microversion: 2.20 time: 0.249702 Apr 11 16:43:13.466467 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8280d1e6-0288-4d94-9975-8174de2d8a1c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:13.467401 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 381/743] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:43:13 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:43:13.475118 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-8280d1e6-0288-4d94-9975-8174de2d8a1c tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1571 microversion: 2.1 time: 0.234882 Apr 11 16:43:13.475740 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 363/744] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:13 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1571 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:14.053181 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-4cce1f94-778c-42b7-8c78-31f901cb6918 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:14.054190 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-4cce1f94-778c-42b7-8c78-31f901cb6918 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:14.077239 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4cce1f94-778c-42b7-8c78-31f901cb6918 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:14.077843 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4cce1f94-778c-42b7-8c78-31f901cb6918 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:14.078627 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4cce1f94-778c-42b7-8c78-31f901cb6918 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:14.079055 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4cce1f94-778c-42b7-8c78-31f901cb6918 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:14.118829 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-4cce1f94-778c-42b7-8c78-31f901cb6918 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Going to try to terminate instance {{(pid=123773) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:43:14.228223 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-4cce1f94-778c-42b7-8c78-31f901cb6918 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "DELETE /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 204 len: 0 microversion: 2.1 time: 0.180205 Apr 11 16:43:14.233263 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 382/745] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:43:14 2022] DELETE /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:43:14.244349 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-fee240b8-93a0-4136-8bcf-f42123ea3362 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:14.245853 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-fee240b8-93a0-4136-8bcf-f42123ea3362 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:14.250816 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-9df5b84c-1e1a-4c18-ad31-98a633416646 req-5aaa5fb2-bcc5-49ce-8383-ff621cf65d6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cccd6eb0-741e-48d1-9539-108d80ff2cad", "name": "network-vif-deleted", "tag": "a6f4f255-f8e2-4c79-9875-d58fd39df6bf"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:43:14.254954 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fee240b8-93a0-4136-8bcf-f42123ea3362 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:14.255799 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fee240b8-93a0-4136-8bcf-f42123ea3362 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:14.256984 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fee240b8-93a0-4136-8bcf-f42123ea3362 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:14.257660 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fee240b8-93a0-4136-8bcf-f42123ea3362 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:14.261260 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-9df5b84c-1e1a-4c18-ad31-98a633416646 req-5aaa5fb2-bcc5-49ce-8383-ff621cf65d6d service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:14.261813 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-9df5b84c-1e1a-4c18-ad31-98a633416646 req-5aaa5fb2-bcc5-49ce-8383-ff621cf65d6d service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:14.281396 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-9df5b84c-1e1a-4c18-ad31-98a633416646 req-5aaa5fb2-bcc5-49ce-8383-ff621cf65d6d service nova] Creating event network-vif-deleted:a6f4f255-f8e2-4c79-9875-d58fd39df6bf for instance cccd6eb0-741e-48d1-9539-108d80ff2cad on hv-cinder-83716 Apr 11 16:43:14.287073 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-9df5b84c-1e1a-4c18-ad31-98a633416646 req-5aaa5fb2-bcc5-49ce-8383-ff621cf65d6d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045129 Apr 11 16:43:14.288387 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 383/746] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:43:14.429208 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-fee240b8-93a0-4136-8bcf-f42123ea3362 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:14.443288 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-fee240b8-93a0-4136-8bcf-f42123ea3362 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1507 microversion: 2.1 time: 0.206505 Apr 11 16:43:14.443288 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 364/747] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:14 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1507 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:14.486586 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-64a9bb80-2260-4e32-89ec-b95a0c09b1bb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:14.487381 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-64a9bb80-2260-4e32-89ec-b95a0c09b1bb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:14.494389 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-bf2c140d-c080-4116-bfa0-3fe08d53741b tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:14.495571 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-64a9bb80-2260-4e32-89ec-b95a0c09b1bb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:14.495854 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-bf2c140d-c080-4116-bfa0-3fe08d53741b tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:14.496601 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-64a9bb80-2260-4e32-89ec-b95a0c09b1bb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:14.497517 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-64a9bb80-2260-4e32-89ec-b95a0c09b1bb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:14.498095 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-64a9bb80-2260-4e32-89ec-b95a0c09b1bb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:14.502189 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bf2c140d-c080-4116-bfa0-3fe08d53741b tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:14.502645 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bf2c140d-c080-4116-bfa0-3fe08d53741b tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:14.503587 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bf2c140d-c080-4116-bfa0-3fe08d53741b tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:14.504168 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bf2c140d-c080-4116-bfa0-3fe08d53741b tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:14.612676 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-bf2c140d-c080-4116-bfa0-3fe08d53741b tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6976dcc895e45bf8421ebab360a9536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad65af0201c40fea0218125fd073de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:14.626491 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-bf2c140d-c080-4116-bfa0-3fe08d53741b tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 200 len: 1220 microversion: 2.1 time: 0.136334 Apr 11 16:43:14.627698 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 365/748] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:14 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 1220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:43:14.695687 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-64a9bb80-2260-4e32-89ec-b95a0c09b1bb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:14.704340 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-64a9bb80-2260-4e32-89ec-b95a0c09b1bb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:14.706169 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-64a9bb80-2260-4e32-89ec-b95a0c09b1bb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:14.707513 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-64a9bb80-2260-4e32-89ec-b95a0c09b1bb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1407 microversion: 2.20 time: 0.227008 Apr 11 16:43:14.708280 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 384/749] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:43:14 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:43:15.076212 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-c530788e-68b0-44da-875d-f61af6002991 req-7c7a7386-4bdd-47b6-90f5-bfa8ea589e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29dde975-c7d2-4621-9914-28ebf83c7285", "name": "network-vif-plugged", "status": "completed", "tag": "49b5ba7a-7f54-4acc-8206-d942c4884181"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:43:15.085778 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-c530788e-68b0-44da-875d-f61af6002991 req-7c7a7386-4bdd-47b6-90f5-bfa8ea589e15 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:15.086372 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-c530788e-68b0-44da-875d-f61af6002991 req-7c7a7386-4bdd-47b6-90f5-bfa8ea589e15 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:15.103106 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-c530788e-68b0-44da-875d-f61af6002991 req-7c7a7386-4bdd-47b6-90f5-bfa8ea589e15 service nova] Creating event network-vif-plugged:49b5ba7a-7f54-4acc-8206-d942c4884181 for instance 29dde975-c7d2-4621-9914-28ebf83c7285 on hv-cinder-83716 Apr 11 16:43:15.110016 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-c530788e-68b0-44da-875d-f61af6002991 req-7c7a7386-4bdd-47b6-90f5-bfa8ea589e15 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037303 Apr 11 16:43:15.110899 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 366/750] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:43:15.466730 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-da5ae100-c32b-4098-bde5-553a1e15fb85 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:15.468817 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-da5ae100-c32b-4098-bde5-553a1e15fb85 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:15.481067 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-da5ae100-c32b-4098-bde5-553a1e15fb85 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:15.482246 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-da5ae100-c32b-4098-bde5-553a1e15fb85 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:15.484049 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-da5ae100-c32b-4098-bde5-553a1e15fb85 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:15.485062 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-da5ae100-c32b-4098-bde5-553a1e15fb85 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:15.648088 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-24ce988c-f8df-47c6-af9c-f88bde80127a tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:15.648794 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-24ce988c-f8df-47c6-af9c-f88bde80127a tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] [instance: cccd6eb0-741e-48d1-9539-108d80ff2cad] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:15.657701 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-24ce988c-f8df-47c6-af9c-f88bde80127a tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:15.658091 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-24ce988c-f8df-47c6-af9c-f88bde80127a tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:15.659464 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-24ce988c-f8df-47c6-af9c-f88bde80127a tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:15.660459 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-24ce988c-f8df-47c6-af9c-f88bde80127a tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:15.675673 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-24ce988c-f8df-47c6-af9c-f88bde80127a tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] HTTP exception thrown: Instance cccd6eb0-741e-48d1-9539-108d80ff2cad could not be found. Apr 11 16:43:15.676371 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-24ce988c-f8df-47c6-af9c-f88bde80127a tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Returning 404 to user: Instance cccd6eb0-741e-48d1-9539-108d80ff2cad could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:43:15.677517 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-24ce988c-f8df-47c6-af9c-f88bde80127a tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad" status: 404 len: 111 microversion: 2.1 time: 0.034664 Apr 11 16:43:15.678081 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 367/751] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:15 2022] GET /compute/v2.1/servers/cccd6eb0-741e-48d1-9539-108d80ff2cad => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 16:43:15.685080 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-da5ae100-c32b-4098-bde5-553a1e15fb85 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:15.695227 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-da5ae100-c32b-4098-bde5-553a1e15fb85 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1507 microversion: 2.1 time: 0.235681 Apr 11 16:43:15.695868 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 385/752] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:15 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1507 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:15.728831 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e1fce869-8361-4e20-87b0-a69d8e611607 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:15.730025 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e1fce869-8361-4e20-87b0-a69d8e611607 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:15.737821 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e1fce869-8361-4e20-87b0-a69d8e611607 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:15.738600 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e1fce869-8361-4e20-87b0-a69d8e611607 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:15.739584 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e1fce869-8361-4e20-87b0-a69d8e611607 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:15.740068 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e1fce869-8361-4e20-87b0-a69d8e611607 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:15.891145 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e1fce869-8361-4e20-87b0-a69d8e611607 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:15.899796 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e1fce869-8361-4e20-87b0-a69d8e611607 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:15.901462 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e1fce869-8361-4e20-87b0-a69d8e611607 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:15.902674 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e1fce869-8361-4e20-87b0-a69d8e611607 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1407 microversion: 2.20 time: 0.179505 Apr 11 16:43:15.903238 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 368/753] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:43:15 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:43:15.940265 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3fa65850-71bf-4f23-882b-1188dd015435 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] Calling method '.version_select at 0x7f741c152280>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:15.961381 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3fa65850-71bf-4f23-882b-1188dd015435 tempest-TestShelveInstance-2112271735 tempest-TestShelveInstance-2112271735-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1532288997" status: 202 len: 0 microversion: 2.1 time: 0.025500 Apr 11 16:43:15.962068 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 386/754] 10.222.0.65 () {58 vars in 1253 bytes} [Mon Apr 11 16:43:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1532288997 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:43:16.304951 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-ccbb29b0-cf61-4c6b-8f77-8316f1fcfb24 req-06713402-23b5-45c9-bf14-cafb7241df5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c", "name": "network-vif-deleted", "tag": "397ce2a8-6d73-4bf8-b796-c54287e1035a"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:43:16.314509 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-ccbb29b0-cf61-4c6b-8f77-8316f1fcfb24 req-06713402-23b5-45c9-bf14-cafb7241df5f service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:16.315109 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-ccbb29b0-cf61-4c6b-8f77-8316f1fcfb24 req-06713402-23b5-45c9-bf14-cafb7241df5f service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:16.328712 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-ccbb29b0-cf61-4c6b-8f77-8316f1fcfb24 req-06713402-23b5-45c9-bf14-cafb7241df5f service nova] Creating event network-vif-deleted:397ce2a8-6d73-4bf8-b796-c54287e1035a for instance 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c on hv-cinder-83716 Apr 11 16:43:16.334510 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-ccbb29b0-cf61-4c6b-8f77-8316f1fcfb24 req-06713402-23b5-45c9-bf14-cafb7241df5f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033468 Apr 11 16:43:16.335280 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 369/755] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:43:16.713049 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-28c2348a-6281-471c-8def-a56304ac54b1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:16.713741 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-28c2348a-6281-471c-8def-a56304ac54b1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:16.720084 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-28c2348a-6281-471c-8def-a56304ac54b1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:16.720541 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-28c2348a-6281-471c-8def-a56304ac54b1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:16.721289 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-28c2348a-6281-471c-8def-a56304ac54b1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:16.721710 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-28c2348a-6281-471c-8def-a56304ac54b1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:16.753474 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-28c2348a-6281-471c-8def-a56304ac54b1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:16.753908 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-28c2348a-6281-471c-8def-a56304ac54b1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:16.754349 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.objects.instance [None req-28c2348a-6281-471c-8def-a56304ac54b1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lazy-loading 'fault' on Instance uuid 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c {{(pid=123773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:43:16.810670 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-28c2348a-6281-471c-8def-a56304ac54b1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:16.819823 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-28c2348a-6281-471c-8def-a56304ac54b1 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 200 len: 1312 microversion: 2.1 time: 0.111044 Apr 11 16:43:16.822668 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 387/756] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:16 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 1312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:16.922945 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-65c181bb-4320-40d6-8c50-38d60261e53d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:16.924207 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-65c181bb-4320-40d6-8c50-38d60261e53d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:16.932524 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-65c181bb-4320-40d6-8c50-38d60261e53d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:16.933313 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-65c181bb-4320-40d6-8c50-38d60261e53d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:16.934733 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-65c181bb-4320-40d6-8c50-38d60261e53d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:16.935383 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-65c181bb-4320-40d6-8c50-38d60261e53d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:17.140151 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-65c181bb-4320-40d6-8c50-38d60261e53d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:17.151158 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-65c181bb-4320-40d6-8c50-38d60261e53d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:17.152925 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-65c181bb-4320-40d6-8c50-38d60261e53d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:17.154185 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-65c181bb-4320-40d6-8c50-38d60261e53d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1407 microversion: 2.20 time: 0.237023 Apr 11 16:43:17.154873 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 370/757] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:43:16 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:43:17.837526 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3393c857-21c2-4c5f-bf66-dc51eb388dce tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:17.838796 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3393c857-21c2-4c5f-bf66-dc51eb388dce tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:17.845479 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3393c857-21c2-4c5f-bf66-dc51eb388dce tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:17.846092 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3393c857-21c2-4c5f-bf66-dc51eb388dce tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:17.847287 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3393c857-21c2-4c5f-bf66-dc51eb388dce tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:17.847906 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3393c857-21c2-4c5f-bf66-dc51eb388dce tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:17.862459 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-3393c857-21c2-4c5f-bf66-dc51eb388dce tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] HTTP exception thrown: Instance 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c could not be found. Apr 11 16:43:17.863428 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3393c857-21c2-4c5f-bf66-dc51eb388dce tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Returning 404 to user: Instance 598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:43:17.864825 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3393c857-21c2-4c5f-bf66-dc51eb388dce tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c" status: 404 len: 111 microversion: 2.1 time: 0.031271 Apr 11 16:43:17.866055 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 388/758] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:17 2022] GET /compute/v2.1/servers/598029c7-f3b9-4f0a-a2c8-b52b4e0ab79c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:43:17.876773 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-6b65f593-27d2-47ee-b0fc-3c4acc78f7e5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:17.877615 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-6b65f593-27d2-47ee-b0fc-3c4acc78f7e5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:17.885221 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6b65f593-27d2-47ee-b0fc-3c4acc78f7e5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:17.886010 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6b65f593-27d2-47ee-b0fc-3c4acc78f7e5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:17.886913 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6b65f593-27d2-47ee-b0fc-3c4acc78f7e5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:17.887401 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6b65f593-27d2-47ee-b0fc-3c4acc78f7e5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:17.915217 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-6b65f593-27d2-47ee-b0fc-3c4acc78f7e5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Going to try to terminate instance {{(pid=123774) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:43:18.011484 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-6b65f593-27d2-47ee-b0fc-3c4acc78f7e5 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 204 len: 0 microversion: 2.1 time: 0.140699 Apr 11 16:43:18.013507 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 371/759] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:43:17 2022] DELETE /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:43:18.024277 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-9017c243-6c95-41d9-95cc-c7d1e117bbad tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:18.033460 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-9017c243-6c95-41d9-95cc-c7d1e117bbad tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:18.050870 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9017c243-6c95-41d9-95cc-c7d1e117bbad tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:18.053466 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9017c243-6c95-41d9-95cc-c7d1e117bbad tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:18.055271 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9017c243-6c95-41d9-95cc-c7d1e117bbad tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:18.056811 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9017c243-6c95-41d9-95cc-c7d1e117bbad tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:18.174552 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-35cb77da-ff9b-4306-8514-b2ca903aeede tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:18.176125 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-35cb77da-ff9b-4306-8514-b2ca903aeede tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:18.184253 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-35cb77da-ff9b-4306-8514-b2ca903aeede tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:18.185702 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-35cb77da-ff9b-4306-8514-b2ca903aeede tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:18.186983 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-35cb77da-ff9b-4306-8514-b2ca903aeede tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:18.187872 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-35cb77da-ff9b-4306-8514-b2ca903aeede tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:18.209744 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9017c243-6c95-41d9-95cc-c7d1e117bbad tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:18.218245 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-9017c243-6c95-41d9-95cc-c7d1e117bbad tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.200178 Apr 11 16:43:18.228674 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 389/760] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:18 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:43:18.338014 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-35cb77da-ff9b-4306-8514-b2ca903aeede tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:18.346825 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-35cb77da-ff9b-4306-8514-b2ca903aeede tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:18.348608 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-35cb77da-ff9b-4306-8514-b2ca903aeede tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:18.350011 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-35cb77da-ff9b-4306-8514-b2ca903aeede tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1600 microversion: 2.20 time: 0.180696 Apr 11 16:43:18.350782 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 372/761] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:43:18 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1600 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:43:18.367952 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b29a50f7-964e-4426-91bb-72033db33889 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:18.368435 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b29a50f7-964e-4426-91bb-72033db33889 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:18.374767 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b29a50f7-964e-4426-91bb-72033db33889 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:18.375213 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b29a50f7-964e-4426-91bb-72033db33889 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:18.376205 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b29a50f7-964e-4426-91bb-72033db33889 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:18.376827 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b29a50f7-964e-4426-91bb-72033db33889 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:18.471277 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b29a50f7-964e-4426-91bb-72033db33889 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.107491 Apr 11 16:43:18.472298 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 390/762] 10.222.0.65 () {60 vars in 1315 bytes} [Mon Apr 11 16:43:18 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:43:19.235587 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-9df8f619-fc1f-402b-9fbc-e263670fdd2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:19.236394 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-9df8f619-fc1f-402b-9fbc-e263670fdd2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:19.243901 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9df8f619-fc1f-402b-9fbc-e263670fdd2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:19.244285 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9df8f619-fc1f-402b-9fbc-e263670fdd2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:19.245694 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9df8f619-fc1f-402b-9fbc-e263670fdd2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:19.246314 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9df8f619-fc1f-402b-9fbc-e263670fdd2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:19.519179 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-9df8f619-fc1f-402b-9fbc-e263670fdd2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:19.528559 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-9df8f619-fc1f-402b-9fbc-e263670fdd2c tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1520 microversion: 2.1 time: 0.296093 Apr 11 16:43:19.540119 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 373/763] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:19 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:19.987678 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-22888af0-c6ee-49c0-b32e-f22a75c8159c req-11739db2-cbf7-4f0a-829f-2b98d4dd13f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29dde975-c7d2-4621-9914-28ebf83c7285", "tag": "49b5ba7a-7f54-4acc-8206-d942c4884181"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:43:19.997020 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-22888af0-c6ee-49c0-b32e-f22a75c8159c req-11739db2-cbf7-4f0a-829f-2b98d4dd13f4 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:19.997417 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-22888af0-c6ee-49c0-b32e-f22a75c8159c req-11739db2-cbf7-4f0a-829f-2b98d4dd13f4 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:20.010665 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-22888af0-c6ee-49c0-b32e-f22a75c8159c req-11739db2-cbf7-4f0a-829f-2b98d4dd13f4 service nova] Creating event network-changed:49b5ba7a-7f54-4acc-8206-d942c4884181 for instance 29dde975-c7d2-4621-9914-28ebf83c7285 on hv-cinder-83716 Apr 11 16:43:20.016708 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-22888af0-c6ee-49c0-b32e-f22a75c8159c req-11739db2-cbf7-4f0a-829f-2b98d4dd13f4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033875 Apr 11 16:43:20.017419 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 391/764] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:43:20.445161 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-dae6796d-2e9d-4953-8332-9a52ae978fd5 req-a54bbad9-1d9b-499f-b185-266461527a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3dc4a3c-61a6-4e27-af48-37b52aa6a959", "name": "network-vif-deleted", "tag": "dda955e6-e188-4b67-ae24-2bcd2bd689f7"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:43:20.458239 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-dae6796d-2e9d-4953-8332-9a52ae978fd5 req-a54bbad9-1d9b-499f-b185-266461527a3a service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:20.458855 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-dae6796d-2e9d-4953-8332-9a52ae978fd5 req-a54bbad9-1d9b-499f-b185-266461527a3a service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:20.471752 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-dae6796d-2e9d-4953-8332-9a52ae978fd5 req-a54bbad9-1d9b-499f-b185-266461527a3a service nova] Creating event network-vif-deleted:dda955e6-e188-4b67-ae24-2bcd2bd689f7 for instance a3dc4a3c-61a6-4e27-af48-37b52aa6a959 on hv-cinder-83716 Apr 11 16:43:20.477595 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-dae6796d-2e9d-4953-8332-9a52ae978fd5 req-a54bbad9-1d9b-499f-b185-266461527a3a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036106 Apr 11 16:43:20.478387 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 374/765] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:43:20.551536 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-0bd7ce1f-581d-4ade-8d3b-07d5a9984d2d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:20.552880 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-0bd7ce1f-581d-4ade-8d3b-07d5a9984d2d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:20.560943 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0bd7ce1f-581d-4ade-8d3b-07d5a9984d2d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:20.561683 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0bd7ce1f-581d-4ade-8d3b-07d5a9984d2d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:20.562743 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0bd7ce1f-581d-4ade-8d3b-07d5a9984d2d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:20.563577 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0bd7ce1f-581d-4ade-8d3b-07d5a9984d2d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:20.658483 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-0bd7ce1f-581d-4ade-8d3b-07d5a9984d2d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a6cb4479a746b2928b5948282f9d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e396e5cb51e143bb84d76c18dba0d403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:20.669431 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-0bd7ce1f-581d-4ade-8d3b-07d5a9984d2d tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 200 len: 1306 microversion: 2.1 time: 0.124647 Apr 11 16:43:20.670337 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 392/766] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:20 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 1306 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:21.688764 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-7b392b1a-e8d0-4f3f-93a5-d0e6363835c3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:21.689619 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-7b392b1a-e8d0-4f3f-93a5-d0e6363835c3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] [instance: a3dc4a3c-61a6-4e27-af48-37b52aa6a959] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:21.696785 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7b392b1a-e8d0-4f3f-93a5-d0e6363835c3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:21.697229 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7b392b1a-e8d0-4f3f-93a5-d0e6363835c3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:21.698024 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7b392b1a-e8d0-4f3f-93a5-d0e6363835c3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:21.698458 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7b392b1a-e8d0-4f3f-93a5-d0e6363835c3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:21.713026 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-7b392b1a-e8d0-4f3f-93a5-d0e6363835c3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] HTTP exception thrown: Instance a3dc4a3c-61a6-4e27-af48-37b52aa6a959 could not be found. Apr 11 16:43:21.713664 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-7b392b1a-e8d0-4f3f-93a5-d0e6363835c3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] Returning 404 to user: Instance a3dc4a3c-61a6-4e27-af48-37b52aa6a959 could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:43:21.714507 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-7b392b1a-e8d0-4f3f-93a5-d0e6363835c3 tempest-ServerRescueNegativeTestJSON-1973653648 tempest-ServerRescueNegativeTestJSON-1973653648-project] 10.222.0.65 "GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959" status: 404 len: 111 microversion: 2.1 time: 0.031360 Apr 11 16:43:21.715081 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 375/767] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:21 2022] GET /compute/v2.1/servers/a3dc4a3c-61a6-4e27-af48-37b52aa6a959 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:43:22.329651 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-6ffe0c04-d7e4-4d6e-9087-ec5e9ec42d3f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1194086937"}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:43:22.330955 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-6ffe0c04-d7e4-4d6e-9087-ec5e9ec42d3f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:22.338058 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6ffe0c04-d7e4-4d6e-9087-ec5e9ec42d3f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:22.338932 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6ffe0c04-d7e4-4d6e-9087-ec5e9ec42d3f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:22.340161 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6ffe0c04-d7e4-4d6e-9087-ec5e9ec42d3f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:22.341083 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6ffe0c04-d7e4-4d6e-9087-ec5e9ec42d3f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:22.592975 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.network.security_group_api [None req-6ffe0c04-d7e4-4d6e-9087-ec5e9ec42d3f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Removing security group 53fb903d-63ec-4004-a1fb-7695785c7fae from port 900247d2-717f-4100-a8c4-2e6811bb9b9b Apr 11 16:43:23.246540 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-6ffe0c04-d7e4-4d6e-9087-ec5e9ec42d3f tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "POST /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d/action" status: 202 len: 0 microversion: 2.1 time: 0.919821 Apr 11 16:43:23.247982 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 393/768] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Apr 11 16:43:22 2022] POST /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d/action => generated 0 bytes in 923 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:43:23.262759 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-01b303ff-eb27-493c-8ea7-33aaafd7e60f req-8af34f5f-a87d-402c-a5e8-97475c98435d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "494cad61-7e0d-49b6-aa92-6354407d825d", "tag": "900247d2-717f-4100-a8c4-2e6811bb9b9b"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:43:23.284442 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-01b303ff-eb27-493c-8ea7-33aaafd7e60f req-8af34f5f-a87d-402c-a5e8-97475c98435d service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:23.284886 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-01b303ff-eb27-493c-8ea7-33aaafd7e60f req-8af34f5f-a87d-402c-a5e8-97475c98435d service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:23.310054 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-01b303ff-eb27-493c-8ea7-33aaafd7e60f req-8af34f5f-a87d-402c-a5e8-97475c98435d service nova] Creating event network-changed:900247d2-717f-4100-a8c4-2e6811bb9b9b for instance 494cad61-7e0d-49b6-aa92-6354407d825d on hv-cinder-83716 Apr 11 16:43:23.321353 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-01b303ff-eb27-493c-8ea7-33aaafd7e60f req-8af34f5f-a87d-402c-a5e8-97475c98435d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065713 Apr 11 16:43:23.322866 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 376/769] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:43:26.330835 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-a15193b2-9dcf-468c-adc4-8882bdef856e req-d799cc3f-8a11-4562-be68-49640169921d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "494cad61-7e0d-49b6-aa92-6354407d825d", "tag": "900247d2-717f-4100-a8c4-2e6811bb9b9b"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:43:26.332476 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-28b4ba15-53e6-4f01-9af8-b58ae9663bc8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:26.336891 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-28b4ba15-53e6-4f01-9af8-b58ae9663bc8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:26.349014 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-28b4ba15-53e6-4f01-9af8-b58ae9663bc8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:26.350840 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-28b4ba15-53e6-4f01-9af8-b58ae9663bc8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:26.354958 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-28b4ba15-53e6-4f01-9af8-b58ae9663bc8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:26.356055 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-a15193b2-9dcf-468c-adc4-8882bdef856e req-d799cc3f-8a11-4562-be68-49640169921d service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:26.356745 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-28b4ba15-53e6-4f01-9af8-b58ae9663bc8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:26.358764 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-a15193b2-9dcf-468c-adc4-8882bdef856e req-d799cc3f-8a11-4562-be68-49640169921d service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:26.396915 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-a15193b2-9dcf-468c-adc4-8882bdef856e req-d799cc3f-8a11-4562-be68-49640169921d service nova] Creating event network-changed:900247d2-717f-4100-a8c4-2e6811bb9b9b for instance 494cad61-7e0d-49b6-aa92-6354407d825d on hv-cinder-83716 Apr 11 16:43:26.407769 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-a15193b2-9dcf-468c-adc4-8882bdef856e req-d799cc3f-8a11-4562-be68-49640169921d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082107 Apr 11 16:43:26.411416 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 377/770] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:43:26.547168 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.objects.instance [None req-28b4ba15-53e6-4f01-9af8-b58ae9663bc8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lazy-loading 'services' on Instance uuid 494cad61-7e0d-49b6-aa92-6354407d825d {{(pid=123773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:43:26.690241 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-28b4ba15-53e6-4f01-9af8-b58ae9663bc8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "DELETE /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d/os-volume_attachments/e82ab761-9e55-4750-9249-49870ae74068" status: 202 len: 0 microversion: 2.1 time: 0.370504 Apr 11 16:43:26.695543 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 394/771] 10.222.0.65 () {58 vars in 1415 bytes} [Mon Apr 11 16:43:26 2022] DELETE /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d/os-volume_attachments/e82ab761-9e55-4750-9249-49870ae74068 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:43:26.701642 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-b81b0f96-cb8e-4d1d-9d8d-5ceeade44189 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:26.703225 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-b81b0f96-cb8e-4d1d-9d8d-5ceeade44189 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:26.713065 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b81b0f96-cb8e-4d1d-9d8d-5ceeade44189 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:26.713743 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b81b0f96-cb8e-4d1d-9d8d-5ceeade44189 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:26.715241 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b81b0f96-cb8e-4d1d-9d8d-5ceeade44189 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:26.716274 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b81b0f96-cb8e-4d1d-9d8d-5ceeade44189 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:26.762610 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-b81b0f96-cb8e-4d1d-9d8d-5ceeade44189 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064668 Apr 11 16:43:26.763892 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 378/772] 10.222.0.65 () {58 vars in 1301 bytes} [Mon Apr 11 16:43:26 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:43:27.776504 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-880dc666-6cf5-4413-b7dc-b9a57c2f2aa4 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:27.777702 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-880dc666-6cf5-4413-b7dc-b9a57c2f2aa4 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:27.783999 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-880dc666-6cf5-4413-b7dc-b9a57c2f2aa4 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:27.784523 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-880dc666-6cf5-4413-b7dc-b9a57c2f2aa4 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:27.785335 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-880dc666-6cf5-4413-b7dc-b9a57c2f2aa4 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:27.785881 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-880dc666-6cf5-4413-b7dc-b9a57c2f2aa4 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:27.815318 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-880dc666-6cf5-4413-b7dc-b9a57c2f2aa4 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043600 Apr 11 16:43:27.815872 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 395/773] 10.222.0.65 () {58 vars in 1301 bytes} [Mon Apr 11 16:43:27 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 16:43:27.826857 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-bb45c2ae-fa91-4dc4-a50e-d4adf5386dbf tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:27.827341 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-bb45c2ae-fa91-4dc4-a50e-d4adf5386dbf tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:27.833985 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bb45c2ae-fa91-4dc4-a50e-d4adf5386dbf tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:27.834420 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bb45c2ae-fa91-4dc4-a50e-d4adf5386dbf tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:27.835171 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bb45c2ae-fa91-4dc4-a50e-d4adf5386dbf tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:27.835671 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bb45c2ae-fa91-4dc4-a50e-d4adf5386dbf tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:27.909332 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-bb45c2ae-fa91-4dc4-a50e-d4adf5386dbf tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] HTTP exception thrown: Instance 494cad61-7e0d-49b6-aa92-6354407d825d is not attached to volume e82ab761-9e55-4750-9249-49870ae74068 Apr 11 16:43:27.909927 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-bb45c2ae-fa91-4dc4-a50e-d4adf5386dbf tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Returning 404 to user: Instance 494cad61-7e0d-49b6-aa92-6354407d825d is not attached to volume e82ab761-9e55-4750-9249-49870ae74068 {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:43:27.910874 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-bb45c2ae-fa91-4dc4-a50e-d4adf5386dbf tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "DELETE /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d/os-volume_attachments/e82ab761-9e55-4750-9249-49870ae74068" status: 404 len: 154 microversion: 2.1 time: 0.088576 Apr 11 16:43:27.911414 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 379/774] 10.222.0.65 () {58 vars in 1415 bytes} [Mon Apr 11 16:43:27 2022] DELETE /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d/os-volume_attachments/e82ab761-9e55-4750-9249-49870ae74068 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:43:29.057798 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-e7f474bf-5e4f-455d-ae53-b2dff05bd951 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:29.058339 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-e7f474bf-5e4f-455d-ae53-b2dff05bd951 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:29.065239 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e7f474bf-5e4f-455d-ae53-b2dff05bd951 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:29.065563 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e7f474bf-5e4f-455d-ae53-b2dff05bd951 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:29.066330 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e7f474bf-5e4f-455d-ae53-b2dff05bd951 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:29.066842 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e7f474bf-5e4f-455d-ae53-b2dff05bd951 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:29.093363 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-e7f474bf-5e4f-455d-ae53-b2dff05bd951 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Going to try to terminate instance {{(pid=123773) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:43:29.172282 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-e7f474bf-5e4f-455d-ae53-b2dff05bd951 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "DELETE /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 204 len: 0 microversion: 2.1 time: 0.117944 Apr 11 16:43:29.172799 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 396/775] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:43:29 2022] DELETE /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:43:29.182174 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e9999bd3-5090-41cc-abf4-1f9ff928a82e tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:29.182816 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e9999bd3-5090-41cc-abf4-1f9ff928a82e tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:29.189674 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e9999bd3-5090-41cc-abf4-1f9ff928a82e tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:29.190096 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e9999bd3-5090-41cc-abf4-1f9ff928a82e tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:29.191122 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e9999bd3-5090-41cc-abf4-1f9ff928a82e tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:29.191552 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e9999bd3-5090-41cc-abf4-1f9ff928a82e tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:29.321766 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1cf4f51f-a5e3-4515-820c-d7eedf25ecee tempest-VolumesGetTestJSON-1181966851 tempest-VolumesGetTestJSON-1181966851-project] Action: 'create', calling method: .version_select at 0x7f741822d700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1936188734", "metadata": {"Type": "work"}}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:43:29.326053 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e9999bd3-5090-41cc-abf4-1f9ff928a82e tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:29.334685 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e9999bd3-5090-41cc-abf4-1f9ff928a82e tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1555 microversion: 2.1 time: 0.156968 Apr 11 16:43:29.335358 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 380/776] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:29 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:29.604736 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1cf4f51f-a5e3-4515-820c-d7eedf25ecee tempest-VolumesGetTestJSON-1181966851 tempest-VolumesGetTestJSON-1181966851-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.399328 Apr 11 16:43:29.605565 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 397/777] 10.222.0.65 () {60 vars in 1155 bytes} [Mon Apr 11 16:43:29 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 401 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Apr 11 16:43:29.616576 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c040bdbe-78d6-475f-873d-df96321f0d5b tempest-VolumesGetTestJSON-1181966851 tempest-VolumesGetTestJSON-1181966851-project] Calling method '.version_select at 0x7f741810eca0>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:29.665466 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c040bdbe-78d6-475f-873d-df96321f0d5b tempest-VolumesGetTestJSON-1181966851 tempest-VolumesGetTestJSON-1181966851-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/25179cdb-beb3-4fff-b465-880f73d1a683" status: 200 len: 353 microversion: 2.1 time: 0.052758 Apr 11 16:43:29.666038 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 381/778] 10.222.0.65 () {58 vars in 1244 bytes} [Mon Apr 11 16:43:29 2022] GET /compute/v2.1/os-volumes/25179cdb-beb3-4fff-b465-880f73d1a683 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:43:30.354018 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f8788a5c-d910-4022-a739-77c608030ab8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:30.354617 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f8788a5c-d910-4022-a739-77c608030ab8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:30.365255 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f8788a5c-d910-4022-a739-77c608030ab8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:30.365685 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f8788a5c-d910-4022-a739-77c608030ab8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:30.366508 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f8788a5c-d910-4022-a739-77c608030ab8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:30.366976 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f8788a5c-d910-4022-a739-77c608030ab8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:30.501598 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f8788a5c-d910-4022-a739-77c608030ab8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:30.509715 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f8788a5c-d910-4022-a739-77c608030ab8 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1555 microversion: 2.1 time: 0.160435 Apr 11 16:43:30.510489 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 398/779] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:30 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:30.679189 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-fdef4367-6917-479d-b086-7ca6d8a34a36 tempest-VolumesGetTestJSON-1181966851 tempest-VolumesGetTestJSON-1181966851-project] Calling method '.version_select at 0x7f7412f20e50>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:30.730061 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-fdef4367-6917-479d-b086-7ca6d8a34a36 tempest-VolumesGetTestJSON-1181966851 tempest-VolumesGetTestJSON-1181966851-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/25179cdb-beb3-4fff-b465-880f73d1a683" status: 200 len: 354 microversion: 2.1 time: 0.055539 Apr 11 16:43:30.730640 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 382/780] 10.222.0.65 () {58 vars in 1244 bytes} [Mon Apr 11 16:43:30 2022] GET /compute/v2.1/os-volumes/25179cdb-beb3-4fff-b465-880f73d1a683 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:43:30.742065 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-a8774880-47ce-4d24-867a-164ad2d239e2 tempest-VolumesGetTestJSON-1181966851 tempest-VolumesGetTestJSON-1181966851-project] Calling method '.version_select at 0x7f741c152b80>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:30.791039 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-a8774880-47ce-4d24-867a-164ad2d239e2 tempest-VolumesGetTestJSON-1181966851 tempest-VolumesGetTestJSON-1181966851-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/25179cdb-beb3-4fff-b465-880f73d1a683" status: 200 len: 354 microversion: 2.1 time: 0.052936 Apr 11 16:43:30.791738 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 399/781] 10.222.0.65 () {58 vars in 1244 bytes} [Mon Apr 11 16:43:30 2022] GET /compute/v2.1/os-volumes/25179cdb-beb3-4fff-b465-880f73d1a683 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:43:30.808161 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-3d4b0efd-41d0-4b94-814b-30943d13fb03 tempest-VolumesGetTestJSON-1181966851 tempest-VolumesGetTestJSON-1181966851-project] Calling method '.version_select at 0x7f74181a8280>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:30.870405 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-3d4b0efd-41d0-4b94-814b-30943d13fb03 tempest-VolumesGetTestJSON-1181966851 tempest-VolumesGetTestJSON-1181966851-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/25179cdb-beb3-4fff-b465-880f73d1a683" status: 202 len: 0 microversion: 2.1 time: 0.065712 Apr 11 16:43:30.871254 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 383/782] 10.222.0.65 () {58 vars in 1247 bytes} [Mon Apr 11 16:43:30 2022] DELETE /compute/v2.1/os-volumes/25179cdb-beb3-4fff-b465-880f73d1a683 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:43:30.879337 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-899c16be-8464-432e-81ff-7e127b86d086 tempest-VolumesGetTestJSON-1181966851 tempest-VolumesGetTestJSON-1181966851-project] Calling method '.version_select at 0x7f741c0ed5e0>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:30.934248 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-899c16be-8464-432e-81ff-7e127b86d086 tempest-VolumesGetTestJSON-1181966851 tempest-VolumesGetTestJSON-1181966851-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/25179cdb-beb3-4fff-b465-880f73d1a683" status: 200 len: 353 microversion: 2.1 time: 0.058813 Apr 11 16:43:30.934831 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 400/783] 10.222.0.65 () {58 vars in 1244 bytes} [Mon Apr 11 16:43:30 2022] GET /compute/v2.1/os-volumes/25179cdb-beb3-4fff-b465-880f73d1a683 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:43:31.526959 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-b09ad622-2a39-49a0-98b8-8e90b4c7f323 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:31.527565 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-b09ad622-2a39-49a0-98b8-8e90b4c7f323 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:31.534025 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b09ad622-2a39-49a0-98b8-8e90b4c7f323 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:31.534460 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b09ad622-2a39-49a0-98b8-8e90b4c7f323 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:31.535966 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b09ad622-2a39-49a0-98b8-8e90b4c7f323 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:31.536105 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b09ad622-2a39-49a0-98b8-8e90b4c7f323 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:31.706089 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-b09ad622-2a39-49a0-98b8-8e90b4c7f323 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b98e0a3c18be4651bb091e7f0c1c387e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f673779bead84d3c9d6d57eb3c65d5eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:31.714257 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-b09ad622-2a39-49a0-98b8-8e90b4c7f323 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 200 len: 1555 microversion: 2.1 time: 0.191242 Apr 11 16:43:31.714924 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 384/784] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:31 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 1555 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:31.912113 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-2092fb0c-0c49-41d0-82a1-f05f82cf51d3 req-5baf51ad-ff02-4fe9-9dd4-8a2dd712634d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "494cad61-7e0d-49b6-aa92-6354407d825d", "name": "network-vif-deleted", "tag": "900247d2-717f-4100-a8c4-2e6811bb9b9b"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:43:31.921879 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-2092fb0c-0c49-41d0-82a1-f05f82cf51d3 req-5baf51ad-ff02-4fe9-9dd4-8a2dd712634d service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:31.922306 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-2092fb0c-0c49-41d0-82a1-f05f82cf51d3 req-5baf51ad-ff02-4fe9-9dd4-8a2dd712634d service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:31.936094 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-2092fb0c-0c49-41d0-82a1-f05f82cf51d3 req-5baf51ad-ff02-4fe9-9dd4-8a2dd712634d service nova] Creating event network-vif-deleted:900247d2-717f-4100-a8c4-2e6811bb9b9b for instance 494cad61-7e0d-49b6-aa92-6354407d825d on hv-cinder-83716 Apr 11 16:43:31.941185 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-2092fb0c-0c49-41d0-82a1-f05f82cf51d3 req-5baf51ad-ff02-4fe9-9dd4-8a2dd712634d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033795 Apr 11 16:43:31.941997 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 401/785] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:43:31.947473 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f82336cc-f83b-43f2-8dd0-560869e0753b tempest-VolumesGetTestJSON-1181966851 tempest-VolumesGetTestJSON-1181966851-project] Calling method '.version_select at 0x7f74181a8e50>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:31.976212 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-f82336cc-f83b-43f2-8dd0-560869e0753b tempest-VolumesGetTestJSON-1181966851 tempest-VolumesGetTestJSON-1181966851-project] HTTP exception thrown: Volume 25179cdb-beb3-4fff-b465-880f73d1a683 could not be found. Apr 11 16:43:31.976812 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f82336cc-f83b-43f2-8dd0-560869e0753b tempest-VolumesGetTestJSON-1181966851 tempest-VolumesGetTestJSON-1181966851-project] Returning 404 to user: Volume 25179cdb-beb3-4fff-b465-880f73d1a683 could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:43:31.977715 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f82336cc-f83b-43f2-8dd0-560869e0753b tempest-VolumesGetTestJSON-1181966851 tempest-VolumesGetTestJSON-1181966851-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/25179cdb-beb3-4fff-b465-880f73d1a683" status: 404 len: 109 microversion: 2.1 time: 0.034774 Apr 11 16:43:31.978271 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 385/786] 10.222.0.65 () {58 vars in 1244 bytes} [Mon Apr 11 16:43:31 2022] GET /compute/v2.1/os-volumes/25179cdb-beb3-4fff-b465-880f73d1a683 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 16:43:32.732391 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3cc31150-c09d-4ce1-84eb-a1fb4b17cb75 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:32.733074 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3cc31150-c09d-4ce1-84eb-a1fb4b17cb75 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] [instance: 494cad61-7e0d-49b6-aa92-6354407d825d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:32.739787 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3cc31150-c09d-4ce1-84eb-a1fb4b17cb75 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:32.740235 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3cc31150-c09d-4ce1-84eb-a1fb4b17cb75 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:32.740998 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3cc31150-c09d-4ce1-84eb-a1fb4b17cb75 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:32.741427 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3cc31150-c09d-4ce1-84eb-a1fb4b17cb75 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:32.755684 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-3cc31150-c09d-4ce1-84eb-a1fb4b17cb75 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] HTTP exception thrown: Instance 494cad61-7e0d-49b6-aa92-6354407d825d could not be found. Apr 11 16:43:32.756520 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3cc31150-c09d-4ce1-84eb-a1fb4b17cb75 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Returning 404 to user: Instance 494cad61-7e0d-49b6-aa92-6354407d825d could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:43:32.757378 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3cc31150-c09d-4ce1-84eb-a1fb4b17cb75 tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d" status: 404 len: 111 microversion: 2.1 time: 0.029376 Apr 11 16:43:32.758157 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 402/787] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:32 2022] GET /compute/v2.1/servers/494cad61-7e0d-49b6-aa92-6354407d825d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:43:32.767222 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-257785ce-9aea-4fa0-97bc-04bb076b5c5c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] Calling method '.version_select at 0x7f74180cf790>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:32.788626 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-257785ce-9aea-4fa0-97bc-04bb076b5c5c tempest-TestMinimumBasicScenario-512736644 tempest-TestMinimumBasicScenario-512736644-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1775347678" status: 202 len: 0 microversion: 2.1 time: 0.025862 Apr 11 16:43:32.789228 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 386/788] 10.222.0.65 () {58 vars in 1271 bytes} [Mon Apr 11 16:43:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1775347678 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:43:40.294034 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ccb533c9-9f2d-43d2-bb5d-6c0fff8425a6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:40.295153 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ccb533c9-9f2d-43d2-bb5d-6c0fff8425a6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:40.301868 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ccb533c9-9f2d-43d2-bb5d-6c0fff8425a6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:40.302315 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ccb533c9-9f2d-43d2-bb5d-6c0fff8425a6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:40.303070 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ccb533c9-9f2d-43d2-bb5d-6c0fff8425a6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:40.303718 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ccb533c9-9f2d-43d2-bb5d-6c0fff8425a6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:40.336597 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ccb533c9-9f2d-43d2-bb5d-6c0fff8425a6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047283 Apr 11 16:43:40.337164 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 403/789] 10.222.0.65 () {58 vars in 1301 bytes} [Mon Apr 11 16:43:40 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 16:43:40.397523 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-7f9cd6a3-8112-4dbe-ba76-0cd543844073 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:40.398109 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-7f9cd6a3-8112-4dbe-ba76-0cd543844073 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:40.404332 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7f9cd6a3-8112-4dbe-ba76-0cd543844073 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:40.404788 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7f9cd6a3-8112-4dbe-ba76-0cd543844073 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:40.405711 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7f9cd6a3-8112-4dbe-ba76-0cd543844073 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:40.406068 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7f9cd6a3-8112-4dbe-ba76-0cd543844073 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:40.431795 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-7f9cd6a3-8112-4dbe-ba76-0cd543844073 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Going to try to terminate instance {{(pid=123774) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:43:40.545613 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-7f9cd6a3-8112-4dbe-ba76-0cd543844073 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 204 len: 0 microversion: 2.1 time: 0.152354 Apr 11 16:43:40.547274 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 387/790] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:43:40 2022] DELETE /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:43:40.557782 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d89ce3c7-825a-47c2-9178-7418ca997e5d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:40.558347 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d89ce3c7-825a-47c2-9178-7418ca997e5d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:40.564975 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d89ce3c7-825a-47c2-9178-7418ca997e5d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:40.565507 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d89ce3c7-825a-47c2-9178-7418ca997e5d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:40.566536 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d89ce3c7-825a-47c2-9178-7418ca997e5d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:40.567075 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d89ce3c7-825a-47c2-9178-7418ca997e5d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:40.796203 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d89ce3c7-825a-47c2-9178-7418ca997e5d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:40.804616 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d89ce3c7-825a-47c2-9178-7418ca997e5d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1675 microversion: 2.1 time: 0.253040 Apr 11 16:43:40.805837 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 404/791] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:40 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1675 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:43:41.823656 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-505b83d0-7ac0-4319-9897-03b02dad6cc4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:41.824511 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-505b83d0-7ac0-4319-9897-03b02dad6cc4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:41.831093 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-505b83d0-7ac0-4319-9897-03b02dad6cc4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:41.831589 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-505b83d0-7ac0-4319-9897-03b02dad6cc4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:41.832500 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-505b83d0-7ac0-4319-9897-03b02dad6cc4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:41.833176 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-505b83d0-7ac0-4319-9897-03b02dad6cc4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:42.064076 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-505b83d0-7ac0-4319-9897-03b02dad6cc4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:42.074101 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-505b83d0-7ac0-4319-9897-03b02dad6cc4 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1675 microversion: 2.1 time: 0.254993 Apr 11 16:43:42.075095 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 388/792] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:41 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1675 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:42.933227 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-e4b29f88-2e04-4e98-814e-a9d012573d96 req-59fbeb3d-023a-4aaa-82b5-b47e68467030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0db1c6a9-bc5a-45f7-bbd3-590292385768", "name": "network-vif-deleted", "tag": "a73169ab-a868-4681-96ea-03b1560d84b4"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:43:42.973805 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-e4b29f88-2e04-4e98-814e-a9d012573d96 req-59fbeb3d-023a-4aaa-82b5-b47e68467030 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:42.974291 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-e4b29f88-2e04-4e98-814e-a9d012573d96 req-59fbeb3d-023a-4aaa-82b5-b47e68467030 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:43.023188 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-e4b29f88-2e04-4e98-814e-a9d012573d96 req-59fbeb3d-023a-4aaa-82b5-b47e68467030 service nova] Creating event network-vif-deleted:a73169ab-a868-4681-96ea-03b1560d84b4 for instance 0db1c6a9-bc5a-45f7-bbd3-590292385768 on hv-cinder-83716 Apr 11 16:43:43.040710 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-e4b29f88-2e04-4e98-814e-a9d012573d96 req-59fbeb3d-023a-4aaa-82b5-b47e68467030 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110883 Apr 11 16:43:43.043037 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 405/793] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:43:43.092114 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-32f7b785-abca-4974-99d9-3f0d4b70d509 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:43.093369 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-32f7b785-abca-4974-99d9-3f0d4b70d509 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:43.107548 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-32f7b785-abca-4974-99d9-3f0d4b70d509 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:43.108276 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-32f7b785-abca-4974-99d9-3f0d4b70d509 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:43.109263 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-32f7b785-abca-4974-99d9-3f0d4b70d509 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:43.109700 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-32f7b785-abca-4974-99d9-3f0d4b70d509 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:43.164877 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-32f7b785-abca-4974-99d9-3f0d4b70d509 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:43.165616 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-32f7b785-abca-4974-99d9-3f0d4b70d509 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:43.166222 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.objects.instance [None req-32f7b785-abca-4974-99d9-3f0d4b70d509 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lazy-loading 'fault' on Instance uuid 0db1c6a9-bc5a-45f7-bbd3-590292385768 {{(pid=123774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:43:43.216677 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-32f7b785-abca-4974-99d9-3f0d4b70d509 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:43.224497 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-32f7b785-abca-4974-99d9-3f0d4b70d509 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 200 len: 1328 microversion: 2.1 time: 0.136423 Apr 11 16:43:43.225763 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 389/794] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:43 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 1328 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:44.242157 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1cfe1dfd-93dd-4f85-965e-07021cd0c75d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:44.243579 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1cfe1dfd-93dd-4f85-965e-07021cd0c75d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:44.251392 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1cfe1dfd-93dd-4f85-965e-07021cd0c75d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:44.252015 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1cfe1dfd-93dd-4f85-965e-07021cd0c75d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:44.252905 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1cfe1dfd-93dd-4f85-965e-07021cd0c75d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:44.253474 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1cfe1dfd-93dd-4f85-965e-07021cd0c75d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:44.268564 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-1cfe1dfd-93dd-4f85-965e-07021cd0c75d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] HTTP exception thrown: Instance 0db1c6a9-bc5a-45f7-bbd3-590292385768 could not be found. Apr 11 16:43:44.269244 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1cfe1dfd-93dd-4f85-965e-07021cd0c75d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Returning 404 to user: Instance 0db1c6a9-bc5a-45f7-bbd3-590292385768 could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:43:44.270114 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1cfe1dfd-93dd-4f85-965e-07021cd0c75d tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 404 len: 111 microversion: 2.1 time: 0.032274 Apr 11 16:43:44.270701 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 406/795] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:44 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:43:44.279826 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d0b4450f-f747-4531-bcdf-ae6bdd1c1d04 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '.version_select at 0x7f74181d5550>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:44.314688 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d0b4450f-f747-4531-bcdf-ae6bdd1c1d04 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1654807370" status: 202 len: 0 microversion: 2.1 time: 0.039001 Apr 11 16:43:44.319337 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 390/796] 10.222.0.65 () {58 vars in 1220 bytes} [Mon Apr 11 16:43:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1654807370 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:43:45.138628 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-6e4e0c12-2cf6-4780-a226-33030f4a2a0b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Action: 'create', calling method: .version_select at 0x7f741c0f94c0>, body: {"keypair": {"name": "tempest-keypair-1945945232"}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:43:45.154438 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-6e4e0c12-2cf6-4780-a226-33030f4a2a0b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Getting quotas for project 90215ff8d2af4f1fa9d0137fcb2f881d. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:43:45.164645 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-6e4e0c12-2cf6-4780-a226-33030f4a2a0b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Getting quotas for user d94b4c03d94440e7b92ea1051cb3625e and project 90215ff8d2af4f1fa9d0137fcb2f881d. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:43:45.300425 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-6e4e0c12-2cf6-4780-a226-33030f4a2a0b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Getting quotas for project 90215ff8d2af4f1fa9d0137fcb2f881d. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:43:45.305167 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-6e4e0c12-2cf6-4780-a226-33030f4a2a0b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Getting quotas for user d94b4c03d94440e7b92ea1051cb3625e and project 90215ff8d2af4f1fa9d0137fcb2f881d. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:43:45.319681 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-6e4e0c12-2cf6-4780-a226-33030f4a2a0b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.185008 Apr 11 16:43:45.323817 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 407/797] 10.222.0.65 () {60 vars in 1157 bytes} [Mon Apr 11 16:43:45 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:47.254616 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-66d13e3d-76af-4dab-8e23-ea5ccf4308e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1632401419", "imageRef": "e989c938-7b7a-445c-aec9-596e81d35104", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "40c7b6b2-a83c-4541-b8fe-c25169cdbc7e"}], "security_groups": [{"name": "tempest-securitygroup--1953088621"}], "key_name": "tempest-keypair-1945945232", "user_data": "}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:43:47.383308 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.network.neutron [None req-66d13e3d-76af-4dab-8e23-ea5ccf4308e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] validate_networks() for [('40c7b6b2-a83c-4541-b8fe-c25169cdbc7e', None, None, None, None, None)] {{(pid=123774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:43:47.900342 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-66d13e3d-76af-4dab-8e23-ea5ccf4308e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Flavor limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:43:47.901063 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-66d13e3d-76af-4dab-8e23-ea5ccf4308e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Image limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:43:47.901210 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-66d13e3d-76af-4dab-8e23-ea5ccf4308e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Flavor pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:43:47.901826 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-66d13e3d-76af-4dab-8e23-ea5ccf4308e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Image pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:43:47.902401 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-66d13e3d-76af-4dab-8e23-ea5ccf4308e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:43:47.913852 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-66d13e3d-76af-4dab-8e23-ea5ccf4308e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:47.914424 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-66d13e3d-76af-4dab-8e23-ea5ccf4308e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:47.915369 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-66d13e3d-76af-4dab-8e23-ea5ccf4308e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:47.916132 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-66d13e3d-76af-4dab-8e23-ea5ccf4308e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:47.943878 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-66d13e3d-76af-4dab-8e23-ea5ccf4308e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Getting quotas for project 90215ff8d2af4f1fa9d0137fcb2f881d. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:43:47.949538 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-66d13e3d-76af-4dab-8e23-ea5ccf4308e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Getting quotas for user d94b4c03d94440e7b92ea1051cb3625e and project 90215ff8d2af4f1fa9d0137fcb2f881d. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:43:47.964537 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-66d13e3d-76af-4dab-8e23-ea5ccf4308e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Going to run 1 instances... {{(pid=123774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:43:47.967529 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-66d13e3d-76af-4dab-8e23-ea5ccf4308e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e989c938-7b7a-445c-aec9-596e81d35104',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:43:48.030194 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-66d13e3d-76af-4dab-8e23-ea5ccf4308e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.783094 Apr 11 16:43:48.047024 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-afbd3582-2d82-493d-8ea2-09f08200a4a1 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:48.047702 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-afbd3582-2d82-493d-8ea2-09f08200a4a1 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:48.051995 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 391/798] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Apr 11 16:43:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 16:43:48.123444 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-afbd3582-2d82-493d-8ea2-09f08200a4a1 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:48.138296 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-afbd3582-2d82-493d-8ea2-09f08200a4a1 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 200 len: 1238 microversion: 2.1 time: 0.095454 Apr 11 16:43:48.149465 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 408/799] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:48 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 1238 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:49.158578 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c9f3d54d-a6c7-4642-bfec-d04f1ef3d03b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:49.159127 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c9f3d54d-a6c7-4642-bfec-d04f1ef3d03b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:49.168190 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c9f3d54d-a6c7-4642-bfec-d04f1ef3d03b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:49.168629 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c9f3d54d-a6c7-4642-bfec-d04f1ef3d03b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:49.169619 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c9f3d54d-a6c7-4642-bfec-d04f1ef3d03b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:49.170053 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c9f3d54d-a6c7-4642-bfec-d04f1ef3d03b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:49.287121 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c9f3d54d-a6c7-4642-bfec-d04f1ef3d03b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:49.297978 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c9f3d54d-a6c7-4642-bfec-d04f1ef3d03b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 200 len: 1290 microversion: 2.1 time: 0.143929 Apr 11 16:43:49.309047 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 392/800] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:49 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 1290 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:50.318720 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ba1b0b39-1004-46e9-a909-a0019ddda3b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:50.319585 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ba1b0b39-1004-46e9-a909-a0019ddda3b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:50.326942 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ba1b0b39-1004-46e9-a909-a0019ddda3b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:50.327807 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ba1b0b39-1004-46e9-a909-a0019ddda3b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:50.328682 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ba1b0b39-1004-46e9-a909-a0019ddda3b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:50.329404 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ba1b0b39-1004-46e9-a909-a0019ddda3b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:50.427041 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ba1b0b39-1004-46e9-a909-a0019ddda3b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:50.435564 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ba1b0b39-1004-46e9-a909-a0019ddda3b8 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 200 len: 1296 microversion: 2.1 time: 0.121375 Apr 11 16:43:50.436307 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 409/801] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:50 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 1296 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:51.345018 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:43:51.345672 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: Mon Apr 11 16:43:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 16:43:51.455000 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-0172523b-26d6-4004-bffe-0788bf179609 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:51.456547 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-0172523b-26d6-4004-bffe-0788bf179609 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:51.466023 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0172523b-26d6-4004-bffe-0788bf179609 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:51.466592 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0172523b-26d6-4004-bffe-0788bf179609 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:51.467650 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0172523b-26d6-4004-bffe-0788bf179609 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:51.468315 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0172523b-26d6-4004-bffe-0788bf179609 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:51.841983 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0172523b-26d6-4004-bffe-0788bf179609 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:51.856432 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-0172523b-26d6-4004-bffe-0788bf179609 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 200 len: 1364 microversion: 2.1 time: 0.405874 Apr 11 16:43:51.857042 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 393/802] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:51 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 1364 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:52.526630 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-d8c353d0-9134-4b08-ad2a-4060f7180303 req-683ed6ec-95a6-4e46-b6d8-05df2f274e5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a90907-9122-446d-899b-e931d741f29a", "tag": "3f96714c-7163-450a-9a97-c521d3e339cf"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:43:52.541717 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-d8c353d0-9134-4b08-ad2a-4060f7180303 req-683ed6ec-95a6-4e46-b6d8-05df2f274e5a service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:52.542249 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-d8c353d0-9134-4b08-ad2a-4060f7180303 req-683ed6ec-95a6-4e46-b6d8-05df2f274e5a service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:52.584397 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-d8c353d0-9134-4b08-ad2a-4060f7180303 req-683ed6ec-95a6-4e46-b6d8-05df2f274e5a service nova] Creating event network-changed:3f96714c-7163-450a-9a97-c521d3e339cf for instance 04a90907-9122-446d-899b-e931d741f29a on hv-cinder-83716 Apr 11 16:43:52.606117 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-d8c353d0-9134-4b08-ad2a-4060f7180303 req-683ed6ec-95a6-4e46-b6d8-05df2f274e5a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084000 Apr 11 16:43:52.607417 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 410/803] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:43:52.873967 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-50af55ff-ee42-4ef0-a033-308590d10505 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:52.874569 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-50af55ff-ee42-4ef0-a033-308590d10505 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:52.891105 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-50af55ff-ee42-4ef0-a033-308590d10505 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:52.891552 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-50af55ff-ee42-4ef0-a033-308590d10505 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:52.892377 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-50af55ff-ee42-4ef0-a033-308590d10505 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:52.892807 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-50af55ff-ee42-4ef0-a033-308590d10505 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:53.264878 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-50af55ff-ee42-4ef0-a033-308590d10505 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:53.273031 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-50af55ff-ee42-4ef0-a033-308590d10505 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 200 len: 1364 microversion: 2.1 time: 0.403741 Apr 11 16:43:53.276342 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 394/804] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:52 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 1364 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:54.293871 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-8d61a651-289d-4d6d-aabb-0da6f87accb9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:54.294567 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-8d61a651-289d-4d6d-aabb-0da6f87accb9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:54.301828 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8d61a651-289d-4d6d-aabb-0da6f87accb9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:54.302624 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8d61a651-289d-4d6d-aabb-0da6f87accb9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:54.303612 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8d61a651-289d-4d6d-aabb-0da6f87accb9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:54.304223 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8d61a651-289d-4d6d-aabb-0da6f87accb9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:54.580782 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-8d61a651-289d-4d6d-aabb-0da6f87accb9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:54.593250 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-8d61a651-289d-4d6d-aabb-0da6f87accb9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 200 len: 1364 microversion: 2.1 time: 0.303980 Apr 11 16:43:54.594254 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 411/805] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:54 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 1364 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:55.614385 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-8f6ec824-8f6e-4ff8-b364-d6d73a62be7b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:55.615204 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-8f6ec824-8f6e-4ff8-b364-d6d73a62be7b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:55.636409 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8f6ec824-8f6e-4ff8-b364-d6d73a62be7b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:55.639621 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8f6ec824-8f6e-4ff8-b364-d6d73a62be7b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:55.641090 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8f6ec824-8f6e-4ff8-b364-d6d73a62be7b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:55.642713 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8f6ec824-8f6e-4ff8-b364-d6d73a62be7b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:55.892798 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8f6ec824-8f6e-4ff8-b364-d6d73a62be7b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:55.902314 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-8f6ec824-8f6e-4ff8-b364-d6d73a62be7b tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 200 len: 1364 microversion: 2.1 time: 0.293722 Apr 11 16:43:55.905505 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 395/806] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:55 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 1364 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:56.119429 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-affdffe4-6434-440b-a01b-08fe6ca525ee tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Action: 'create', calling method: .version_select at 0x7f741818db80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1851676367"}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:43:56.141275 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-affdffe4-6434-440b-a01b-08fe6ca525ee tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Getting quotas for project cc3803567a904d698675781a5ccd07cd. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:43:56.146206 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-affdffe4-6434-440b-a01b-08fe6ca525ee tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Getting quotas for user 80844604b91746398c8ae7dde54d0dd3 and project cc3803567a904d698675781a5ccd07cd. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:43:56.474293 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-affdffe4-6434-440b-a01b-08fe6ca525ee tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Getting quotas for project cc3803567a904d698675781a5ccd07cd. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:43:56.478030 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-affdffe4-6434-440b-a01b-08fe6ca525ee tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Getting quotas for user 80844604b91746398c8ae7dde54d0dd3 and project cc3803567a904d698675781a5ccd07cd. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:43:56.492375 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-affdffe4-6434-440b-a01b-08fe6ca525ee tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.651700 Apr 11 16:43:56.493285 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 412/807] 10.222.0.65 () {60 vars in 1157 bytes} [Mon Apr 11 16:43:55 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:56.922399 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f94d95c3-e431-40e9-b4e9-7b0b539edcb3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:56.923966 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f94d95c3-e431-40e9-b4e9-7b0b539edcb3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:56.932081 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f94d95c3-e431-40e9-b4e9-7b0b539edcb3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:56.932957 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f94d95c3-e431-40e9-b4e9-7b0b539edcb3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:56.934231 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f94d95c3-e431-40e9-b4e9-7b0b539edcb3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:56.934989 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f94d95c3-e431-40e9-b4e9-7b0b539edcb3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:57.163511 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f94d95c3-e431-40e9-b4e9-7b0b539edcb3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:57.172481 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f94d95c3-e431-40e9-b4e9-7b0b539edcb3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 200 len: 1364 microversion: 2.1 time: 0.253965 Apr 11 16:43:57.173297 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 396/808] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:56 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 1364 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:58.194208 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-636a44bc-2773-4dfe-af98-59e48de00433 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:58.195050 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-636a44bc-2773-4dfe-af98-59e48de00433 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:58.206139 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-636a44bc-2773-4dfe-af98-59e48de00433 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:58.207131 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-636a44bc-2773-4dfe-af98-59e48de00433 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:58.208040 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-636a44bc-2773-4dfe-af98-59e48de00433 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:58.208707 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-636a44bc-2773-4dfe-af98-59e48de00433 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:58.426071 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-636a44bc-2773-4dfe-af98-59e48de00433 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:58.435170 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-636a44bc-2773-4dfe-af98-59e48de00433 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 200 len: 1364 microversion: 2.1 time: 0.248086 Apr 11 16:43:58.435931 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 413/809] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:58 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:59.453899 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a30cda4e-907d-4960-b4a7-b855aa6186b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:43:59.455216 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a30cda4e-907d-4960-b4a7-b855aa6186b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:43:59.462769 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a30cda4e-907d-4960-b4a7-b855aa6186b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:59.463493 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a30cda4e-907d-4960-b4a7-b855aa6186b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:59.464587 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a30cda4e-907d-4960-b4a7-b855aa6186b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:59.465213 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a30cda4e-907d-4960-b4a7-b855aa6186b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:59.621667 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a30cda4e-907d-4960-b4a7-b855aa6186b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:43:59.633357 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a30cda4e-907d-4960-b4a7-b855aa6186b9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 200 len: 1364 microversion: 2.1 time: 0.184198 Apr 11 16:43:59.633989 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 397/810] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:43:59 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:43:59.811961 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-9bf8c394-f5c5-4898-a5b5-8e97beab65e3 req-f8dba0f2-22b4-461d-bf66-a5f4efd0f7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a90907-9122-446d-899b-e931d741f29a", "name": "network-vif-plugged", "status": "completed", "tag": "3f96714c-7163-450a-9a97-c521d3e339cf"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:43:59.834839 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-9bf8c394-f5c5-4898-a5b5-8e97beab65e3 req-f8dba0f2-22b4-461d-bf66-a5f4efd0f7b0 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:43:59.835310 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-9bf8c394-f5c5-4898-a5b5-8e97beab65e3 req-f8dba0f2-22b4-461d-bf66-a5f4efd0f7b0 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:43:59.849950 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-9bf8c394-f5c5-4898-a5b5-8e97beab65e3 req-f8dba0f2-22b4-461d-bf66-a5f4efd0f7b0 service nova] Creating event network-vif-plugged:3f96714c-7163-450a-9a97-c521d3e339cf for instance 04a90907-9122-446d-899b-e931d741f29a on hv-cinder-83716 Apr 11 16:43:59.856124 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-9bf8c394-f5c5-4898-a5b5-8e97beab65e3 req-f8dba0f2-22b4-461d-bf66-a5f4efd0f7b0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047743 Apr 11 16:43:59.858052 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 414/811] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:44:00.650938 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-2d95d8b0-eb3b-4284-9d2c-83cb3d702e04 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:00.651594 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-2d95d8b0-eb3b-4284-9d2c-83cb3d702e04 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:00.659163 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2d95d8b0-eb3b-4284-9d2c-83cb3d702e04 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:00.659663 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2d95d8b0-eb3b-4284-9d2c-83cb3d702e04 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:00.660689 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2d95d8b0-eb3b-4284-9d2c-83cb3d702e04 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:00.661046 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2d95d8b0-eb3b-4284-9d2c-83cb3d702e04 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:00.877526 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-2d95d8b0-eb3b-4284-9d2c-83cb3d702e04 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:00.890263 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-2d95d8b0-eb3b-4284-9d2c-83cb3d702e04 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 200 len: 1364 microversion: 2.1 time: 0.243586 Apr 11 16:44:00.891254 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 398/812] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:44:00 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 1364 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:44:01.921256 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-85da3d1c-b864-4a52-b243-ab46aa2625cb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:01.922310 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-85da3d1c-b864-4a52-b243-ab46aa2625cb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:01.932690 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-85da3d1c-b864-4a52-b243-ab46aa2625cb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:01.933418 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-85da3d1c-b864-4a52-b243-ab46aa2625cb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:01.934569 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-85da3d1c-b864-4a52-b243-ab46aa2625cb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:01.935233 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-85da3d1c-b864-4a52-b243-ab46aa2625cb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:02.079938 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-85da3d1c-b864-4a52-b243-ab46aa2625cb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:02.087485 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-85da3d1c-b864-4a52-b243-ab46aa2625cb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 200 len: 1364 microversion: 2.1 time: 0.173855 Apr 11 16:44:02.088076 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 415/813] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:44:01 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:44:03.106071 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c0b73e7a-22b7-4944-8c26-7250748be3c3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:03.106708 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c0b73e7a-22b7-4944-8c26-7250748be3c3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:03.113125 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c0b73e7a-22b7-4944-8c26-7250748be3c3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:03.113575 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c0b73e7a-22b7-4944-8c26-7250748be3c3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:03.114357 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c0b73e7a-22b7-4944-8c26-7250748be3c3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:03.114788 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c0b73e7a-22b7-4944-8c26-7250748be3c3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:03.255803 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c0b73e7a-22b7-4944-8c26-7250748be3c3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:03.263848 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c0b73e7a-22b7-4944-8c26-7250748be3c3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 200 len: 1551 microversion: 2.1 time: 0.161968 Apr 11 16:44:03.264463 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 399/814] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:44:03 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 1551 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:44:03.281295 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-08bff3d2-6034-40f0-b1f2-6c6923a78460 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:03.281907 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-08bff3d2-6034-40f0-b1f2-6c6923a78460 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:03.289022 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-08bff3d2-6034-40f0-b1f2-6c6923a78460 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:03.289468 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-08bff3d2-6034-40f0-b1f2-6c6923a78460 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:03.290341 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-08bff3d2-6034-40f0-b1f2-6c6923a78460 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:03.290768 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-08bff3d2-6034-40f0-b1f2-6c6923a78460 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:03.374225 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-08bff3d2-6034-40f0-b1f2-6c6923a78460 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097031 Apr 11 16:44:03.374822 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 416/815] 10.222.0.65 () {58 vars in 1274 bytes} [Mon Apr 11 16:44:03 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:44:04.568154 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-fd6b8603-64b0-4b16-a473-a491fdaf3d50 req-29af2118-132d-40c1-89fe-6cf61b1c4f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a90907-9122-446d-899b-e931d741f29a", "tag": "3f96714c-7163-450a-9a97-c521d3e339cf"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:44:04.581149 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-fd6b8603-64b0-4b16-a473-a491fdaf3d50 req-29af2118-132d-40c1-89fe-6cf61b1c4f46 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:04.581684 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-fd6b8603-64b0-4b16-a473-a491fdaf3d50 req-29af2118-132d-40c1-89fe-6cf61b1c4f46 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:04.599508 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-fd6b8603-64b0-4b16-a473-a491fdaf3d50 req-29af2118-132d-40c1-89fe-6cf61b1c4f46 service nova] Creating event network-changed:3f96714c-7163-450a-9a97-c521d3e339cf for instance 04a90907-9122-446d-899b-e931d741f29a on hv-cinder-83716 Apr 11 16:44:04.608004 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-fd6b8603-64b0-4b16-a473-a491fdaf3d50 req-29af2118-132d-40c1-89fe-6cf61b1c4f46 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045375 Apr 11 16:44:04.608885 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 400/816] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:44:21.684014 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-72034872-2765-4bad-953c-d6ad619b9f44 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1565389020", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1851676367", "security_groups": [{"name": "tempest-secgroup-smoke-1299759803"}], "block_device_mapping_v2": [{"uuid": "2d3f63cd-ed9b-4a08-949e-2724c84fc690", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c96476d8-c52f-4e3f-b8a6-4bfa7b594cfc"}]}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:44:21.805465 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.network.neutron [None req-72034872-2765-4bad-953c-d6ad619b9f44 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] validate_networks() for [('c96476d8-c52f-4e3f-b8a6-4bfa7b594cfc', None, None, None, None, None)] {{(pid=123773) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:44:22.220777 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-72034872-2765-4bad-953c-d6ad619b9f44 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Flavor limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:44:22.221224 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-72034872-2765-4bad-953c-d6ad619b9f44 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Image limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:44:22.221679 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-72034872-2765-4bad-953c-d6ad619b9f44 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Flavor pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:44:22.222121 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-72034872-2765-4bad-953c-d6ad619b9f44 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Image pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:44:22.222529 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-72034872-2765-4bad-953c-d6ad619b9f44 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:44:22.231731 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-72034872-2765-4bad-953c-d6ad619b9f44 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:22.232220 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-72034872-2765-4bad-953c-d6ad619b9f44 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:22.233203 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-72034872-2765-4bad-953c-d6ad619b9f44 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:22.233921 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-72034872-2765-4bad-953c-d6ad619b9f44 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:22.251831 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-72034872-2765-4bad-953c-d6ad619b9f44 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Getting quotas for project cc3803567a904d698675781a5ccd07cd. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:44:22.256330 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-72034872-2765-4bad-953c-d6ad619b9f44 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Getting quotas for user 80844604b91746398c8ae7dde54d0dd3 and project cc3803567a904d698675781a5ccd07cd. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:44:22.318634 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-72034872-2765-4bad-953c-d6ad619b9f44 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Going to run 1 instances... {{(pid=123773) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:44:22.321153 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-72034872-2765-4bad-953c-d6ad619b9f44 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2d3f63cd-ed9b-4a08-949e-2724c84fc690',volume_size=None,volume_type=None)] {{(pid=123773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:44:22.463799 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-72034872-2765-4bad-953c-d6ad619b9f44 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.784185 Apr 11 16:44:22.464471 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 417/817] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Apr 11 16:44:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 16:44:22.476365 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e5dc23bc-e5bd-4ca2-b57a-6a203db4a5d2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:22.477059 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e5dc23bc-e5bd-4ca2-b57a-6a203db4a5d2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:22.540783 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e5dc23bc-e5bd-4ca2-b57a-6a203db4a5d2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:22.547859 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e5dc23bc-e5bd-4ca2-b57a-6a203db4a5d2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1095 microversion: 2.1 time: 0.076298 Apr 11 16:44:22.548447 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 401/818] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:44:22 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:44:23.569409 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-07ba5291-46ea-4a27-8617-368a021e99a3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:23.570366 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-07ba5291-46ea-4a27-8617-368a021e99a3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:23.577306 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-07ba5291-46ea-4a27-8617-368a021e99a3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:23.578021 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-07ba5291-46ea-4a27-8617-368a021e99a3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:23.578988 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-07ba5291-46ea-4a27-8617-368a021e99a3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:23.579394 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-07ba5291-46ea-4a27-8617-368a021e99a3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:23.664005 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-07ba5291-46ea-4a27-8617-368a021e99a3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:23.675758 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-07ba5291-46ea-4a27-8617-368a021e99a3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1211 microversion: 2.1 time: 0.110842 Apr 11 16:44:23.676376 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 418/819] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:44:23 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1211 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:44:24.696006 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-6760bfd5-3e19-49dd-b293-cf72091c18b0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:24.697064 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-6760bfd5-3e19-49dd-b293-cf72091c18b0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:24.706814 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6760bfd5-3e19-49dd-b293-cf72091c18b0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:24.707568 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6760bfd5-3e19-49dd-b293-cf72091c18b0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:24.708874 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6760bfd5-3e19-49dd-b293-cf72091c18b0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:24.709649 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-6760bfd5-3e19-49dd-b293-cf72091c18b0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:24.978710 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-6760bfd5-3e19-49dd-b293-cf72091c18b0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:24.986950 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-6760bfd5-3e19-49dd-b293-cf72091c18b0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1267 microversion: 2.1 time: 0.296403 Apr 11 16:44:24.987517 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 402/820] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:44:24 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1267 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:44:25.134948 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-a83fc76e-7da1-4376-ab3a-2a5da1ae3d6b req-839b6972-c0e5-408b-8e67-001eb525db14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb39f773-fda3-4634-8e69-055b9315e3ba", "tag": "67220eb2-d14a-4887-a614-ae13ad4fa4be"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:44:25.170132 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-a83fc76e-7da1-4376-ab3a-2a5da1ae3d6b req-839b6972-c0e5-408b-8e67-001eb525db14 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:25.170605 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-a83fc76e-7da1-4376-ab3a-2a5da1ae3d6b req-839b6972-c0e5-408b-8e67-001eb525db14 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:25.198104 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-a83fc76e-7da1-4376-ab3a-2a5da1ae3d6b req-839b6972-c0e5-408b-8e67-001eb525db14 service nova] Creating event network-changed:67220eb2-d14a-4887-a614-ae13ad4fa4be for instance bb39f773-fda3-4634-8e69-055b9315e3ba on hv-cinder-83716 Apr 11 16:44:25.207473 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-a83fc76e-7da1-4376-ab3a-2a5da1ae3d6b req-839b6972-c0e5-408b-8e67-001eb525db14 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076931 Apr 11 16:44:25.209736 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 419/821] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:44:26.008312 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d079401d-eaa1-4fc4-8d31-476699f9e2b9 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:26.008945 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d079401d-eaa1-4fc4-8d31-476699f9e2b9 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:26.016346 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d079401d-eaa1-4fc4-8d31-476699f9e2b9 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:26.016807 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d079401d-eaa1-4fc4-8d31-476699f9e2b9 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:26.017577 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d079401d-eaa1-4fc4-8d31-476699f9e2b9 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:26.018115 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d079401d-eaa1-4fc4-8d31-476699f9e2b9 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:26.187211 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d079401d-eaa1-4fc4-8d31-476699f9e2b9 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:26.197148 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d079401d-eaa1-4fc4-8d31-476699f9e2b9 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1267 microversion: 2.1 time: 0.193788 Apr 11 16:44:26.197927 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 403/822] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:44:26 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:44:27.216927 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-39591526-0cd2-4749-b6ce-fdd6e04e3e24 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:27.217615 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-39591526-0cd2-4749-b6ce-fdd6e04e3e24 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:27.224336 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-39591526-0cd2-4749-b6ce-fdd6e04e3e24 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:27.224784 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-39591526-0cd2-4749-b6ce-fdd6e04e3e24 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:27.225557 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-39591526-0cd2-4749-b6ce-fdd6e04e3e24 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:27.225985 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-39591526-0cd2-4749-b6ce-fdd6e04e3e24 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:27.375983 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-39591526-0cd2-4749-b6ce-fdd6e04e3e24 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:27.385710 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-39591526-0cd2-4749-b6ce-fdd6e04e3e24 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1267 microversion: 2.1 time: 0.173081 Apr 11 16:44:27.386164 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 420/823] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:44:27 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:44:28.404610 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f53fc04c-92c2-48a2-b9b4-1e3704531ed8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:28.405230 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f53fc04c-92c2-48a2-b9b4-1e3704531ed8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:28.413002 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f53fc04c-92c2-48a2-b9b4-1e3704531ed8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:28.413444 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f53fc04c-92c2-48a2-b9b4-1e3704531ed8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:28.414230 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f53fc04c-92c2-48a2-b9b4-1e3704531ed8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:28.414656 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f53fc04c-92c2-48a2-b9b4-1e3704531ed8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:28.575936 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f53fc04c-92c2-48a2-b9b4-1e3704531ed8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:28.584131 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f53fc04c-92c2-48a2-b9b4-1e3704531ed8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1267 microversion: 2.1 time: 0.184498 Apr 11 16:44:28.584776 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 404/824] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:44:28 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:44:29.604877 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3b169a7d-4bcc-4e5b-8e33-bc8539b22252 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:29.605708 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3b169a7d-4bcc-4e5b-8e33-bc8539b22252 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:29.614619 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3b169a7d-4bcc-4e5b-8e33-bc8539b22252 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:29.615383 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3b169a7d-4bcc-4e5b-8e33-bc8539b22252 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:29.616507 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3b169a7d-4bcc-4e5b-8e33-bc8539b22252 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:29.617276 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3b169a7d-4bcc-4e5b-8e33-bc8539b22252 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:29.774404 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3b169a7d-4bcc-4e5b-8e33-bc8539b22252 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:29.785132 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3b169a7d-4bcc-4e5b-8e33-bc8539b22252 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1267 microversion: 2.1 time: 0.186047 Apr 11 16:44:29.785888 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 421/825] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:44:29 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:44:30.804035 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c6574664-9627-4b1e-bc3a-be17222063a4 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:30.804700 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c6574664-9627-4b1e-bc3a-be17222063a4 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:30.811447 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c6574664-9627-4b1e-bc3a-be17222063a4 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:30.811927 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c6574664-9627-4b1e-bc3a-be17222063a4 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:30.812738 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c6574664-9627-4b1e-bc3a-be17222063a4 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:30.813174 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c6574664-9627-4b1e-bc3a-be17222063a4 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:30.955099 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c6574664-9627-4b1e-bc3a-be17222063a4 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:30.963113 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c6574664-9627-4b1e-bc3a-be17222063a4 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1267 microversion: 2.1 time: 0.163160 Apr 11 16:44:30.963753 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 405/826] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:44:30 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:44:31.984219 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c413d280-8f0e-48cc-a7c2-30268d85afbf tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:31.984792 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c413d280-8f0e-48cc-a7c2-30268d85afbf tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:31.991831 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c413d280-8f0e-48cc-a7c2-30268d85afbf tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:31.992279 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c413d280-8f0e-48cc-a7c2-30268d85afbf tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:31.993053 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c413d280-8f0e-48cc-a7c2-30268d85afbf tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:31.993822 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c413d280-8f0e-48cc-a7c2-30268d85afbf tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:32.123847 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c413d280-8f0e-48cc-a7c2-30268d85afbf tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:32.131925 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c413d280-8f0e-48cc-a7c2-30268d85afbf tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1267 microversion: 2.1 time: 0.151616 Apr 11 16:44:32.132466 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 422/827] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:44:31 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:44:33.153548 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f27f4d55-5672-4a48-a2d4-0aa15cee2c27 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:33.154555 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f27f4d55-5672-4a48-a2d4-0aa15cee2c27 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:33.163927 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f27f4d55-5672-4a48-a2d4-0aa15cee2c27 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:33.164376 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f27f4d55-5672-4a48-a2d4-0aa15cee2c27 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:33.165149 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f27f4d55-5672-4a48-a2d4-0aa15cee2c27 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:33.165579 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f27f4d55-5672-4a48-a2d4-0aa15cee2c27 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:33.295885 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f27f4d55-5672-4a48-a2d4-0aa15cee2c27 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:33.303884 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f27f4d55-5672-4a48-a2d4-0aa15cee2c27 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1267 microversion: 2.1 time: 0.156893 Apr 11 16:44:33.304465 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 406/828] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:44:33 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:44:34.321271 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-bf883bde-0eda-4af5-a049-bdcf395160d7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:34.321849 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-bf883bde-0eda-4af5-a049-bdcf395160d7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:34.328680 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bf883bde-0eda-4af5-a049-bdcf395160d7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:34.329129 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bf883bde-0eda-4af5-a049-bdcf395160d7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:34.329907 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bf883bde-0eda-4af5-a049-bdcf395160d7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:34.330338 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bf883bde-0eda-4af5-a049-bdcf395160d7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:34.471762 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-bf883bde-0eda-4af5-a049-bdcf395160d7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:34.479766 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-bf883bde-0eda-4af5-a049-bdcf395160d7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1267 microversion: 2.1 time: 0.162480 Apr 11 16:44:34.480316 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 423/829] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:44:34 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:44:35.496233 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-3783b0af-1ced-4de9-bcfb-309b4dcf4329 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:35.496833 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-3783b0af-1ced-4de9-bcfb-309b4dcf4329 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:35.503520 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3783b0af-1ced-4de9-bcfb-309b4dcf4329 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:35.503988 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3783b0af-1ced-4de9-bcfb-309b4dcf4329 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:35.504760 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3783b0af-1ced-4de9-bcfb-309b4dcf4329 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:35.505357 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3783b0af-1ced-4de9-bcfb-309b4dcf4329 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:35.645451 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-3783b0af-1ced-4de9-bcfb-309b4dcf4329 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:35.653659 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-3783b0af-1ced-4de9-bcfb-309b4dcf4329 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1267 microversion: 2.1 time: 0.161718 Apr 11 16:44:35.654281 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 407/830] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:44:35 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:44:36.671281 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-48b98ad2-b62a-4204-808c-1727f47c41a2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:36.671855 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-48b98ad2-b62a-4204-808c-1727f47c41a2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:36.678904 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-48b98ad2-b62a-4204-808c-1727f47c41a2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:36.679346 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-48b98ad2-b62a-4204-808c-1727f47c41a2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:36.680147 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-48b98ad2-b62a-4204-808c-1727f47c41a2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:36.680579 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-48b98ad2-b62a-4204-808c-1727f47c41a2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:37.102563 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-48b98ad2-b62a-4204-808c-1727f47c41a2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:37.110535 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-48b98ad2-b62a-4204-808c-1727f47c41a2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1267 microversion: 2.1 time: 0.443365 Apr 11 16:44:37.111107 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 424/831] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:44:36 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1267 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:44:37.366337 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-035a66cc-c4a2-4cf3-825a-63175357f73c req-e2d5d1bd-a45b-47c0-a189-993bb8946e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb39f773-fda3-4634-8e69-055b9315e3ba", "name": "network-vif-plugged", "status": "completed", "tag": "67220eb2-d14a-4887-a614-ae13ad4fa4be"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:44:37.375575 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-035a66cc-c4a2-4cf3-825a-63175357f73c req-e2d5d1bd-a45b-47c0-a189-993bb8946e6c service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:37.376235 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-035a66cc-c4a2-4cf3-825a-63175357f73c req-e2d5d1bd-a45b-47c0-a189-993bb8946e6c service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:37.387866 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-035a66cc-c4a2-4cf3-825a-63175357f73c req-e2d5d1bd-a45b-47c0-a189-993bb8946e6c service nova] Creating event network-vif-plugged:67220eb2-d14a-4887-a614-ae13ad4fa4be for instance bb39f773-fda3-4634-8e69-055b9315e3ba on hv-cinder-83716 Apr 11 16:44:37.392965 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-035a66cc-c4a2-4cf3-825a-63175357f73c req-e2d5d1bd-a45b-47c0-a189-993bb8946e6c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030850 Apr 11 16:44:37.393758 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 408/832] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:44:38.128239 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-93c1d018-f6ce-4e76-8f0c-b68731009ea5 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:38.128817 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-93c1d018-f6ce-4e76-8f0c-b68731009ea5 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:38.135597 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-93c1d018-f6ce-4e76-8f0c-b68731009ea5 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:38.136078 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-93c1d018-f6ce-4e76-8f0c-b68731009ea5 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:38.136848 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-93c1d018-f6ce-4e76-8f0c-b68731009ea5 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:38.137281 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-93c1d018-f6ce-4e76-8f0c-b68731009ea5 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:38.274698 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-93c1d018-f6ce-4e76-8f0c-b68731009ea5 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:38.282214 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-93c1d018-f6ce-4e76-8f0c-b68731009ea5 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1267 microversion: 2.1 time: 0.157930 Apr 11 16:44:38.282842 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 425/833] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:44:38 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:44:39.304120 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ebb79b92-475a-4c5e-93b9-919c2037ce09 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:39.305022 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ebb79b92-475a-4c5e-93b9-919c2037ce09 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:39.314393 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ebb79b92-475a-4c5e-93b9-919c2037ce09 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:39.315108 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ebb79b92-475a-4c5e-93b9-919c2037ce09 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:39.316258 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ebb79b92-475a-4c5e-93b9-919c2037ce09 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:39.316779 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ebb79b92-475a-4c5e-93b9-919c2037ce09 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:39.458799 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ebb79b92-475a-4c5e-93b9-919c2037ce09 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:39.474069 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ebb79b92-475a-4c5e-93b9-919c2037ce09 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1454 microversion: 2.1 time: 0.177564 Apr 11 16:44:39.474671 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 409/834] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:44:39 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1454 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:44:39.491963 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-e89f516c-b387-40d0-a04c-d9bed4c642f0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:39.492562 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-e89f516c-b387-40d0-a04c-d9bed4c642f0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:39.499571 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e89f516c-b387-40d0-a04c-d9bed4c642f0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:39.500039 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e89f516c-b387-40d0-a04c-d9bed4c642f0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:39.500800 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e89f516c-b387-40d0-a04c-d9bed4c642f0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:39.501220 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e89f516c-b387-40d0-a04c-d9bed4c642f0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:39.634328 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-e89f516c-b387-40d0-a04c-d9bed4c642f0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:39.641999 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-e89f516c-b387-40d0-a04c-d9bed4c642f0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1454 microversion: 2.1 time: 0.155165 Apr 11 16:44:39.642556 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 426/835] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:44:39 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:44:41.784640 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-eabadeb5-aac7-40b7-a214-f0473ea36788 req-760575c5-c26d-4873-9940-05eccfb293a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb39f773-fda3-4634-8e69-055b9315e3ba", "tag": "67220eb2-d14a-4887-a614-ae13ad4fa4be"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:44:41.793826 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-eabadeb5-aac7-40b7-a214-f0473ea36788 req-760575c5-c26d-4873-9940-05eccfb293a0 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:41.794266 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-eabadeb5-aac7-40b7-a214-f0473ea36788 req-760575c5-c26d-4873-9940-05eccfb293a0 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:41.809159 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-eabadeb5-aac7-40b7-a214-f0473ea36788 req-760575c5-c26d-4873-9940-05eccfb293a0 service nova] Creating event network-changed:67220eb2-d14a-4887-a614-ae13ad4fa4be for instance bb39f773-fda3-4634-8e69-055b9315e3ba on hv-cinder-83716 Apr 11 16:44:41.814299 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-eabadeb5-aac7-40b7-a214-f0473ea36788 req-760575c5-c26d-4873-9940-05eccfb293a0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033311 Apr 11 16:44:41.814919 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 410/836] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:44:47.158463 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-170677bb-8b79-4395-b073-f9054875e0f0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:47.159078 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-170677bb-8b79-4395-b073-f9054875e0f0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:47.165780 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-170677bb-8b79-4395-b073-f9054875e0f0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:47.166227 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-170677bb-8b79-4395-b073-f9054875e0f0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:47.167005 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-170677bb-8b79-4395-b073-f9054875e0f0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:47.167435 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-170677bb-8b79-4395-b073-f9054875e0f0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:47.190364 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-170677bb-8b79-4395-b073-f9054875e0f0 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285/ips" status: 200 len: 151 microversion: 2.20 time: 0.035851 Apr 11 16:44:47.190955 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 427/837] 10.222.0.65 () {60 vars in 1288 bytes} [Mon Apr 11 16:44:47 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:44:49.402789 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-707083ff-1cd3-4ced-a7f5-6676d587e90d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:44:49.403422 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-707083ff-1cd3-4ced-a7f5-6676d587e90d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:49.410246 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-707083ff-1cd3-4ced-a7f5-6676d587e90d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:49.410691 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-707083ff-1cd3-4ced-a7f5-6676d587e90d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:49.411600 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-707083ff-1cd3-4ced-a7f5-6676d587e90d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:49.412384 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-707083ff-1cd3-4ced-a7f5-6676d587e90d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:49.435939 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.objects.instance [None req-707083ff-1cd3-4ced-a7f5-6676d587e90d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lazy-loading 'flavor' on Instance uuid 29dde975-c7d2-4621-9914-28ebf83c7285 {{(pid=123774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:44:49.699896 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-707083ff-1cd3-4ced-a7f5-6676d587e90d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "POST /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285/action" status: 202 len: 0 microversion: 2.20 time: 0.301673 Apr 11 16:44:49.700598 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 411/838] 10.222.0.65 () {62 vars in 1318 bytes} [Mon Apr 11 16:44:49 2022] POST /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:44:49.709642 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b0ab6886-f536-42c9-ba7b-87a648474aff tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:49.710254 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b0ab6886-f536-42c9-ba7b-87a648474aff tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:49.717125 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b0ab6886-f536-42c9-ba7b-87a648474aff tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:49.717606 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b0ab6886-f536-42c9-ba7b-87a648474aff tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:49.718403 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b0ab6886-f536-42c9-ba7b-87a648474aff tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:49.718830 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b0ab6886-f536-42c9-ba7b-87a648474aff tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:49.861041 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b0ab6886-f536-42c9-ba7b-87a648474aff tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:49.870124 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b0ab6886-f536-42c9-ba7b-87a648474aff tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:49.871613 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b0ab6886-f536-42c9-ba7b-87a648474aff tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:49.872788 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b0ab6886-f536-42c9-ba7b-87a648474aff tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1723 microversion: 2.20 time: 0.167729 Apr 11 16:44:49.873353 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 428/839] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:44:49 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:44:50.892709 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-4ffe4e4c-4474-45ea-87a9-59d931853986 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:50.893397 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-4ffe4e4c-4474-45ea-87a9-59d931853986 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:50.900611 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4ffe4e4c-4474-45ea-87a9-59d931853986 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:50.901032 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4ffe4e4c-4474-45ea-87a9-59d931853986 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:50.901834 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4ffe4e4c-4474-45ea-87a9-59d931853986 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:50.902268 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-4ffe4e4c-4474-45ea-87a9-59d931853986 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:51.034584 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-4ffe4e4c-4474-45ea-87a9-59d931853986 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:51.042933 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-4ffe4e4c-4474-45ea-87a9-59d931853986 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:51.044454 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-4ffe4e4c-4474-45ea-87a9-59d931853986 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:51.045635 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-4ffe4e4c-4474-45ea-87a9-59d931853986 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1723 microversion: 2.20 time: 0.157837 Apr 11 16:44:51.046195 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 412/840] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:44:50 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:44:52.066980 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-e9801ad0-9690-452a-9e59-357069315b90 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:52.068068 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-e9801ad0-9690-452a-9e59-357069315b90 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:52.075390 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e9801ad0-9690-452a-9e59-357069315b90 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:52.075992 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e9801ad0-9690-452a-9e59-357069315b90 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:52.076780 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e9801ad0-9690-452a-9e59-357069315b90 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:52.077215 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e9801ad0-9690-452a-9e59-357069315b90 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:52.220503 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-e9801ad0-9690-452a-9e59-357069315b90 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:52.229194 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-e9801ad0-9690-452a-9e59-357069315b90 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:52.230657 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-e9801ad0-9690-452a-9e59-357069315b90 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:52.231864 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-e9801ad0-9690-452a-9e59-357069315b90 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1723 microversion: 2.20 time: 0.170789 Apr 11 16:44:52.232421 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 429/841] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:44:52 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:44:53.253069 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a2763493-1e9e-4e49-bcc6-c6ce316f794e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:53.253860 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a2763493-1e9e-4e49-bcc6-c6ce316f794e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:53.261517 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a2763493-1e9e-4e49-bcc6-c6ce316f794e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:53.261963 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a2763493-1e9e-4e49-bcc6-c6ce316f794e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:53.262740 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a2763493-1e9e-4e49-bcc6-c6ce316f794e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:53.263168 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a2763493-1e9e-4e49-bcc6-c6ce316f794e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:53.407936 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a2763493-1e9e-4e49-bcc6-c6ce316f794e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:53.416488 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a2763493-1e9e-4e49-bcc6-c6ce316f794e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:53.417973 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a2763493-1e9e-4e49-bcc6-c6ce316f794e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:53.419124 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a2763493-1e9e-4e49-bcc6-c6ce316f794e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1723 microversion: 2.20 time: 0.171289 Apr 11 16:44:53.419706 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 413/842] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:44:53 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:44:54.438351 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d50e8452-ce0c-4241-8e9e-458c3ac101a7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:54.439041 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d50e8452-ce0c-4241-8e9e-458c3ac101a7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:54.445568 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d50e8452-ce0c-4241-8e9e-458c3ac101a7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:54.446005 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d50e8452-ce0c-4241-8e9e-458c3ac101a7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:54.446779 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d50e8452-ce0c-4241-8e9e-458c3ac101a7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:54.447205 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d50e8452-ce0c-4241-8e9e-458c3ac101a7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:54.583906 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d50e8452-ce0c-4241-8e9e-458c3ac101a7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:54.592533 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d50e8452-ce0c-4241-8e9e-458c3ac101a7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:54.593986 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d50e8452-ce0c-4241-8e9e-458c3ac101a7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:54.595211 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d50e8452-ce0c-4241-8e9e-458c3ac101a7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1723 microversion: 2.20 time: 0.160884 Apr 11 16:44:54.595870 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 430/843] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:44:54 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:44:55.613752 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-61907c32-fc6c-46bf-8205-914938a74bc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:55.614396 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-61907c32-fc6c-46bf-8205-914938a74bc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:55.621785 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-61907c32-fc6c-46bf-8205-914938a74bc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:55.622223 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-61907c32-fc6c-46bf-8205-914938a74bc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:55.622996 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-61907c32-fc6c-46bf-8205-914938a74bc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:55.623418 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-61907c32-fc6c-46bf-8205-914938a74bc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:55.767449 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-61907c32-fc6c-46bf-8205-914938a74bc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:55.776905 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-61907c32-fc6c-46bf-8205-914938a74bc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:55.778437 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-61907c32-fc6c-46bf-8205-914938a74bc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:55.779668 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-61907c32-fc6c-46bf-8205-914938a74bc4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1723 microversion: 2.20 time: 0.170045 Apr 11 16:44:55.780247 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 414/844] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:44:55 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:44:56.798576 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-61039606-580f-4a93-b53a-0ed67a4ab204 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:56.799214 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-61039606-580f-4a93-b53a-0ed67a4ab204 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:56.806162 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-61039606-580f-4a93-b53a-0ed67a4ab204 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:56.806611 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-61039606-580f-4a93-b53a-0ed67a4ab204 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:56.807397 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-61039606-580f-4a93-b53a-0ed67a4ab204 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:56.807962 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-61039606-580f-4a93-b53a-0ed67a4ab204 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:56.945565 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-61039606-580f-4a93-b53a-0ed67a4ab204 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:56.954174 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-61039606-580f-4a93-b53a-0ed67a4ab204 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:56.955656 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-61039606-580f-4a93-b53a-0ed67a4ab204 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:56.956846 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-61039606-580f-4a93-b53a-0ed67a4ab204 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1723 microversion: 2.20 time: 0.162281 Apr 11 16:44:56.957415 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 431/845] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:44:56 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:44:57.976069 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-79fa3d0e-fd78-4eaf-9162-16bad3ccf2be tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:57.976659 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-79fa3d0e-fd78-4eaf-9162-16bad3ccf2be tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:57.983683 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-79fa3d0e-fd78-4eaf-9162-16bad3ccf2be tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:57.984143 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-79fa3d0e-fd78-4eaf-9162-16bad3ccf2be tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:57.984940 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-79fa3d0e-fd78-4eaf-9162-16bad3ccf2be tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:57.985368 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-79fa3d0e-fd78-4eaf-9162-16bad3ccf2be tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:58.136243 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-79fa3d0e-fd78-4eaf-9162-16bad3ccf2be tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:58.148449 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-79fa3d0e-fd78-4eaf-9162-16bad3ccf2be tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:58.150720 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-79fa3d0e-fd78-4eaf-9162-16bad3ccf2be tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:58.152319 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-79fa3d0e-fd78-4eaf-9162-16bad3ccf2be tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1723 microversion: 2.20 time: 0.180528 Apr 11 16:44:58.153156 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 415/846] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:44:57 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:44:59.171650 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-517b47c5-621d-4545-81be-af4c779325be tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:44:59.172356 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-517b47c5-621d-4545-81be-af4c779325be tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:44:59.179373 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-517b47c5-621d-4545-81be-af4c779325be tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:59.179853 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-517b47c5-621d-4545-81be-af4c779325be tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:59.180628 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-517b47c5-621d-4545-81be-af4c779325be tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:44:59.181056 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-517b47c5-621d-4545-81be-af4c779325be tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:44:59.338147 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-517b47c5-621d-4545-81be-af4c779325be tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:59.351306 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-517b47c5-621d-4545-81be-af4c779325be tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:59.354360 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-517b47c5-621d-4545-81be-af4c779325be tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:44:59.356167 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-517b47c5-621d-4545-81be-af4c779325be tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1723 microversion: 2.20 time: 0.188457 Apr 11 16:44:59.357083 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 432/847] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:44:59 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:00.376353 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-030095e8-08d5-4908-b328-e11635a5f4ea tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:00.376933 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-030095e8-08d5-4908-b328-e11635a5f4ea tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:00.387146 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-030095e8-08d5-4908-b328-e11635a5f4ea tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:00.387671 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-030095e8-08d5-4908-b328-e11635a5f4ea tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:00.388457 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-030095e8-08d5-4908-b328-e11635a5f4ea tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:00.388891 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-030095e8-08d5-4908-b328-e11635a5f4ea tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:00.560257 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-030095e8-08d5-4908-b328-e11635a5f4ea tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:00.569972 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-030095e8-08d5-4908-b328-e11635a5f4ea tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:00.571542 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-030095e8-08d5-4908-b328-e11635a5f4ea tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:00.572754 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-030095e8-08d5-4908-b328-e11635a5f4ea tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1723 microversion: 2.20 time: 0.200769 Apr 11 16:45:00.573321 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 416/848] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:00 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:01.599897 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-656a57e5-366b-4a81-902e-ebf1f2da8ddd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:01.600574 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-656a57e5-366b-4a81-902e-ebf1f2da8ddd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:01.608692 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-656a57e5-366b-4a81-902e-ebf1f2da8ddd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:01.609204 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-656a57e5-366b-4a81-902e-ebf1f2da8ddd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:01.610113 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-656a57e5-366b-4a81-902e-ebf1f2da8ddd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:01.610641 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-656a57e5-366b-4a81-902e-ebf1f2da8ddd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:01.767674 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-656a57e5-366b-4a81-902e-ebf1f2da8ddd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:01.778012 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-656a57e5-366b-4a81-902e-ebf1f2da8ddd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:01.779521 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-656a57e5-366b-4a81-902e-ebf1f2da8ddd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:01.780777 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-656a57e5-366b-4a81-902e-ebf1f2da8ddd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1744 microversion: 2.20 time: 0.185325 Apr 11 16:45:01.781345 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 433/849] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:01 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1744 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:02.802577 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c7c459ba-fc89-4c50-bd75-b19e8d96b46a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:02.803471 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c7c459ba-fc89-4c50-bd75-b19e8d96b46a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:02.810849 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c7c459ba-fc89-4c50-bd75-b19e8d96b46a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:02.811336 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c7c459ba-fc89-4c50-bd75-b19e8d96b46a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:02.812149 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c7c459ba-fc89-4c50-bd75-b19e8d96b46a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:02.812579 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c7c459ba-fc89-4c50-bd75-b19e8d96b46a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:02.977288 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c7c459ba-fc89-4c50-bd75-b19e8d96b46a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:02.985845 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c7c459ba-fc89-4c50-bd75-b19e8d96b46a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:02.987406 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c7c459ba-fc89-4c50-bd75-b19e8d96b46a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:02.988625 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c7c459ba-fc89-4c50-bd75-b19e8d96b46a tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1744 microversion: 2.20 time: 0.190395 Apr 11 16:45:02.989319 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 417/850] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:02 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1744 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:04.008346 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-9c7cf55b-fcb4-41b0-98a8-8f409c41f3d5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:04.009008 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-9c7cf55b-fcb4-41b0-98a8-8f409c41f3d5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:04.015842 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9c7cf55b-fcb4-41b0-98a8-8f409c41f3d5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:04.016277 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9c7cf55b-fcb4-41b0-98a8-8f409c41f3d5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:04.017055 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9c7cf55b-fcb4-41b0-98a8-8f409c41f3d5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:04.017512 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9c7cf55b-fcb4-41b0-98a8-8f409c41f3d5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:04.156881 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9c7cf55b-fcb4-41b0-98a8-8f409c41f3d5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:04.166038 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9c7cf55b-fcb4-41b0-98a8-8f409c41f3d5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:04.167538 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9c7cf55b-fcb4-41b0-98a8-8f409c41f3d5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:04.168735 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-9c7cf55b-fcb4-41b0-98a8-8f409c41f3d5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1744 microversion: 2.20 time: 0.164503 Apr 11 16:45:04.169294 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 434/851] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:04 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:05.189140 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-8a40ebeb-951a-4a2e-9fa5-4c500cb327ec tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:05.189845 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-8a40ebeb-951a-4a2e-9fa5-4c500cb327ec tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:05.197364 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8a40ebeb-951a-4a2e-9fa5-4c500cb327ec tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:05.197809 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8a40ebeb-951a-4a2e-9fa5-4c500cb327ec tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:05.198689 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8a40ebeb-951a-4a2e-9fa5-4c500cb327ec tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:05.199212 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8a40ebeb-951a-4a2e-9fa5-4c500cb327ec tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:05.344746 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8a40ebeb-951a-4a2e-9fa5-4c500cb327ec tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:05.354376 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8a40ebeb-951a-4a2e-9fa5-4c500cb327ec tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:05.356177 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8a40ebeb-951a-4a2e-9fa5-4c500cb327ec tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:05.357566 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-8a40ebeb-951a-4a2e-9fa5-4c500cb327ec tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1744 microversion: 2.20 time: 0.172902 Apr 11 16:45:05.358123 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 418/852] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:05 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:05.566822 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-30a43534-8fad-47e7-9465-162c5d15f6e8 req-5c6876fe-a7b3-4311-b5ea-c6c06569d2bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29dde975-c7d2-4621-9914-28ebf83c7285", "name": "network-vif-plugged", "status": "completed", "tag": "49b5ba7a-7f54-4acc-8206-d942c4884181"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:45:05.575748 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-30a43534-8fad-47e7-9465-162c5d15f6e8 req-5c6876fe-a7b3-4311-b5ea-c6c06569d2bc service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:05.576184 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-30a43534-8fad-47e7-9465-162c5d15f6e8 req-5c6876fe-a7b3-4311-b5ea-c6c06569d2bc service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:05.589694 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-30a43534-8fad-47e7-9465-162c5d15f6e8 req-5c6876fe-a7b3-4311-b5ea-c6c06569d2bc service nova] Creating event network-vif-plugged:49b5ba7a-7f54-4acc-8206-d942c4884181 for instance 29dde975-c7d2-4621-9914-28ebf83c7285 on hv-cinder-83716 Apr 11 16:45:05.595853 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-30a43534-8fad-47e7-9465-162c5d15f6e8 req-5c6876fe-a7b3-4311-b5ea-c6c06569d2bc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032464 Apr 11 16:45:05.596515 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 435/853] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:45:06.377789 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f498ab0f-706d-4f40-9117-4079c4d47cfe tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:06.378476 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f498ab0f-706d-4f40-9117-4079c4d47cfe tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:06.386917 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f498ab0f-706d-4f40-9117-4079c4d47cfe tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:06.387442 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f498ab0f-706d-4f40-9117-4079c4d47cfe tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:06.388352 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f498ab0f-706d-4f40-9117-4079c4d47cfe tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:06.388809 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f498ab0f-706d-4f40-9117-4079c4d47cfe tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:06.552131 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f498ab0f-706d-4f40-9117-4079c4d47cfe tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:06.562147 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f498ab0f-706d-4f40-9117-4079c4d47cfe tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:06.563812 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f498ab0f-706d-4f40-9117-4079c4d47cfe tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:06.565132 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f498ab0f-706d-4f40-9117-4079c4d47cfe tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1744 microversion: 2.20 time: 0.191892 Apr 11 16:45:06.565750 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 419/854] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:06 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1744 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:07.585629 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-5a5d724a-27bc-442b-9766-5742f8b28707 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:07.586415 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-5a5d724a-27bc-442b-9766-5742f8b28707 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:07.593498 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5a5d724a-27bc-442b-9766-5742f8b28707 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:07.593975 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5a5d724a-27bc-442b-9766-5742f8b28707 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:07.594689 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5a5d724a-27bc-442b-9766-5742f8b28707 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:07.595152 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5a5d724a-27bc-442b-9766-5742f8b28707 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:07.728832 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5a5d724a-27bc-442b-9766-5742f8b28707 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:07.736804 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5a5d724a-27bc-442b-9766-5742f8b28707 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:07.738298 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5a5d724a-27bc-442b-9766-5742f8b28707 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:07.739445 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-5a5d724a-27bc-442b-9766-5742f8b28707 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1739 microversion: 2.20 time: 0.159067 Apr 11 16:45:07.740154 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 436/855] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:07 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:08.760547 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-fadb6038-b527-4508-b35d-c705fbbab40f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:08.761827 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-fadb6038-b527-4508-b35d-c705fbbab40f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:08.769265 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fadb6038-b527-4508-b35d-c705fbbab40f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:08.769708 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fadb6038-b527-4508-b35d-c705fbbab40f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:08.770509 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fadb6038-b527-4508-b35d-c705fbbab40f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:08.770943 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-fadb6038-b527-4508-b35d-c705fbbab40f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:08.921684 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-fadb6038-b527-4508-b35d-c705fbbab40f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:08.930772 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-fadb6038-b527-4508-b35d-c705fbbab40f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:08.932196 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-fadb6038-b527-4508-b35d-c705fbbab40f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:08.933358 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-fadb6038-b527-4508-b35d-c705fbbab40f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1739 microversion: 2.20 time: 0.177357 Apr 11 16:45:08.933918 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 420/856] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:08 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:09.952092 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-bff587e6-6706-4ba6-bdc7-214fbf984209 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:09.952721 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-bff587e6-6706-4ba6-bdc7-214fbf984209 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:09.959461 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bff587e6-6706-4ba6-bdc7-214fbf984209 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:09.959960 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bff587e6-6706-4ba6-bdc7-214fbf984209 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:09.960736 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bff587e6-6706-4ba6-bdc7-214fbf984209 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:09.961165 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-bff587e6-6706-4ba6-bdc7-214fbf984209 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:10.113680 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-bff587e6-6706-4ba6-bdc7-214fbf984209 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:10.122906 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-bff587e6-6706-4ba6-bdc7-214fbf984209 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:10.124487 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-bff587e6-6706-4ba6-bdc7-214fbf984209 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:10.125706 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-bff587e6-6706-4ba6-bdc7-214fbf984209 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1739 microversion: 2.20 time: 0.177862 Apr 11 16:45:10.126267 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 437/857] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:09 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:11.144471 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-8e13fd7e-5e3e-4de1-9978-d2c08dff618f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:11.145105 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-8e13fd7e-5e3e-4de1-9978-d2c08dff618f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:11.152107 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8e13fd7e-5e3e-4de1-9978-d2c08dff618f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:11.152551 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8e13fd7e-5e3e-4de1-9978-d2c08dff618f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:11.153558 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8e13fd7e-5e3e-4de1-9978-d2c08dff618f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:11.154195 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8e13fd7e-5e3e-4de1-9978-d2c08dff618f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:11.305832 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8e13fd7e-5e3e-4de1-9978-d2c08dff618f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:11.314476 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8e13fd7e-5e3e-4de1-9978-d2c08dff618f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:11.316052 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8e13fd7e-5e3e-4de1-9978-d2c08dff618f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:11.317286 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-8e13fd7e-5e3e-4de1-9978-d2c08dff618f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1739 microversion: 2.20 time: 0.176887 Apr 11 16:45:11.317931 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 421/858] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:11 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:12.336814 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d30a00c6-bb2a-4abd-811f-87d3f263ac7f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:12.337356 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d30a00c6-bb2a-4abd-811f-87d3f263ac7f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:12.344159 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d30a00c6-bb2a-4abd-811f-87d3f263ac7f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:12.344605 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d30a00c6-bb2a-4abd-811f-87d3f263ac7f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:12.345359 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d30a00c6-bb2a-4abd-811f-87d3f263ac7f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:12.345966 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d30a00c6-bb2a-4abd-811f-87d3f263ac7f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:12.481715 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d30a00c6-bb2a-4abd-811f-87d3f263ac7f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:12.491854 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d30a00c6-bb2a-4abd-811f-87d3f263ac7f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:12.494011 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d30a00c6-bb2a-4abd-811f-87d3f263ac7f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:12.495250 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d30a00c6-bb2a-4abd-811f-87d3f263ac7f tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1739 microversion: 2.20 time: 0.162559 Apr 11 16:45:12.495943 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 438/859] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:12 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:13.521535 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-74f0bb01-10fb-4796-ad7f-2df2462c9ad7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:13.522274 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-74f0bb01-10fb-4796-ad7f-2df2462c9ad7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:13.534574 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-74f0bb01-10fb-4796-ad7f-2df2462c9ad7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:13.535123 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-74f0bb01-10fb-4796-ad7f-2df2462c9ad7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:13.540728 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-74f0bb01-10fb-4796-ad7f-2df2462c9ad7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:13.541271 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-74f0bb01-10fb-4796-ad7f-2df2462c9ad7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:13.694567 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-74f0bb01-10fb-4796-ad7f-2df2462c9ad7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:13.703033 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-74f0bb01-10fb-4796-ad7f-2df2462c9ad7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:13.704658 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-74f0bb01-10fb-4796-ad7f-2df2462c9ad7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:13.706053 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-74f0bb01-10fb-4796-ad7f-2df2462c9ad7 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1739 microversion: 2.20 time: 0.195743 Apr 11 16:45:13.716998 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 422/860] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:13 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:14.725176 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-46d6d3cb-927d-4625-8d32-9c81ad6fa78d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:14.726492 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-46d6d3cb-927d-4625-8d32-9c81ad6fa78d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:14.733267 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-46d6d3cb-927d-4625-8d32-9c81ad6fa78d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:14.733958 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-46d6d3cb-927d-4625-8d32-9c81ad6fa78d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:14.734948 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-46d6d3cb-927d-4625-8d32-9c81ad6fa78d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:14.735661 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-46d6d3cb-927d-4625-8d32-9c81ad6fa78d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:14.907032 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-46d6d3cb-927d-4625-8d32-9c81ad6fa78d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:14.915820 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-46d6d3cb-927d-4625-8d32-9c81ad6fa78d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:14.917306 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-46d6d3cb-927d-4625-8d32-9c81ad6fa78d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:14.918411 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-46d6d3cb-927d-4625-8d32-9c81ad6fa78d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1739 microversion: 2.20 time: 0.197454 Apr 11 16:45:14.918947 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 439/861] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:14 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:15.938503 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d6e70624-7aa5-41a5-9a6e-3023b5223c1b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:15.939802 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d6e70624-7aa5-41a5-9a6e-3023b5223c1b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:15.947054 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d6e70624-7aa5-41a5-9a6e-3023b5223c1b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:15.947496 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d6e70624-7aa5-41a5-9a6e-3023b5223c1b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:15.948374 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d6e70624-7aa5-41a5-9a6e-3023b5223c1b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:15.948786 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d6e70624-7aa5-41a5-9a6e-3023b5223c1b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:16.123555 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d6e70624-7aa5-41a5-9a6e-3023b5223c1b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:16.132445 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d6e70624-7aa5-41a5-9a6e-3023b5223c1b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:16.133969 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d6e70624-7aa5-41a5-9a6e-3023b5223c1b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:16.135225 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d6e70624-7aa5-41a5-9a6e-3023b5223c1b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1739 microversion: 2.20 time: 0.201083 Apr 11 16:45:16.136097 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 423/862] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:15 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:17.154697 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-060ff3a0-daa9-4666-b6a5-ff7834c251ef tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:17.156251 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-060ff3a0-daa9-4666-b6a5-ff7834c251ef tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:17.163543 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-060ff3a0-daa9-4666-b6a5-ff7834c251ef tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:17.164036 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-060ff3a0-daa9-4666-b6a5-ff7834c251ef tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:17.164827 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-060ff3a0-daa9-4666-b6a5-ff7834c251ef tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:17.165262 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-060ff3a0-daa9-4666-b6a5-ff7834c251ef tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:17.507878 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-060ff3a0-daa9-4666-b6a5-ff7834c251ef tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:17.517803 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-060ff3a0-daa9-4666-b6a5-ff7834c251ef tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:17.519335 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-060ff3a0-daa9-4666-b6a5-ff7834c251ef tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:17.520735 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-060ff3a0-daa9-4666-b6a5-ff7834c251ef tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1739 microversion: 2.20 time: 0.369910 Apr 11 16:45:17.532573 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 440/863] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:17 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1739 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:18.544722 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-2df40955-3ace-454c-bae5-85d8e3da19f3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:18.546128 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-2df40955-3ace-454c-bae5-85d8e3da19f3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:18.553597 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2df40955-3ace-454c-bae5-85d8e3da19f3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:18.554332 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2df40955-3ace-454c-bae5-85d8e3da19f3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:18.555329 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2df40955-3ace-454c-bae5-85d8e3da19f3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:18.556006 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2df40955-3ace-454c-bae5-85d8e3da19f3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:18.863974 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-2df40955-3ace-454c-bae5-85d8e3da19f3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:18.873938 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-2df40955-3ace-454c-bae5-85d8e3da19f3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:18.875883 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-2df40955-3ace-454c-bae5-85d8e3da19f3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:18.877423 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-2df40955-3ace-454c-bae5-85d8e3da19f3 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1739 microversion: 2.20 time: 0.337114 Apr 11 16:45:18.879674 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 424/864] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:18 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1739 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:19.897523 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-6f61b4bd-2dd0-4dad-b768-dc0718b694c5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:19.898491 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-6f61b4bd-2dd0-4dad-b768-dc0718b694c5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:19.906045 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6f61b4bd-2dd0-4dad-b768-dc0718b694c5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:19.906487 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6f61b4bd-2dd0-4dad-b768-dc0718b694c5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:19.907628 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6f61b4bd-2dd0-4dad-b768-dc0718b694c5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:19.908302 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6f61b4bd-2dd0-4dad-b768-dc0718b694c5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:20.139214 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6f61b4bd-2dd0-4dad-b768-dc0718b694c5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:20.148579 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6f61b4bd-2dd0-4dad-b768-dc0718b694c5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:20.149974 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6f61b4bd-2dd0-4dad-b768-dc0718b694c5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:20.151148 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-6f61b4bd-2dd0-4dad-b768-dc0718b694c5 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1739 microversion: 2.20 time: 0.257692 Apr 11 16:45:20.151695 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 441/865] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:19 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1739 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:21.170901 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-23c32972-4997-4b48-8f43-a236ba3e14e4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:21.171604 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-23c32972-4997-4b48-8f43-a236ba3e14e4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:21.178865 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-23c32972-4997-4b48-8f43-a236ba3e14e4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:21.179320 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-23c32972-4997-4b48-8f43-a236ba3e14e4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:21.180149 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-23c32972-4997-4b48-8f43-a236ba3e14e4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:21.180586 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-23c32972-4997-4b48-8f43-a236ba3e14e4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:21.316351 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-23c32972-4997-4b48-8f43-a236ba3e14e4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:21.325058 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-23c32972-4997-4b48-8f43-a236ba3e14e4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:21.326618 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-23c32972-4997-4b48-8f43-a236ba3e14e4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:21.327959 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-23c32972-4997-4b48-8f43-a236ba3e14e4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1721 microversion: 2.20 time: 0.161060 Apr 11 16:45:21.328626 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 425/866] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:21 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:22.346903 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-4dd04f8b-896f-4f1f-85c2-70e3885c5447 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:22.347544 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-4dd04f8b-896f-4f1f-85c2-70e3885c5447 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:22.354622 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4dd04f8b-896f-4f1f-85c2-70e3885c5447 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:22.355070 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4dd04f8b-896f-4f1f-85c2-70e3885c5447 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:22.355873 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4dd04f8b-896f-4f1f-85c2-70e3885c5447 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:22.356293 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4dd04f8b-896f-4f1f-85c2-70e3885c5447 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:22.511902 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-4dd04f8b-896f-4f1f-85c2-70e3885c5447 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:22.520647 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-4dd04f8b-896f-4f1f-85c2-70e3885c5447 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:22.522639 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-4dd04f8b-896f-4f1f-85c2-70e3885c5447 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:22.523851 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-4dd04f8b-896f-4f1f-85c2-70e3885c5447 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1721 microversion: 2.20 time: 0.181038 Apr 11 16:45:22.524523 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 442/867] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:22 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:23.543503 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-8d5964b1-a23d-4045-bdc8-e579c8375590 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:23.544149 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-8d5964b1-a23d-4045-bdc8-e579c8375590 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:23.551268 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8d5964b1-a23d-4045-bdc8-e579c8375590 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:23.551866 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8d5964b1-a23d-4045-bdc8-e579c8375590 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:23.552683 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8d5964b1-a23d-4045-bdc8-e579c8375590 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:23.553750 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8d5964b1-a23d-4045-bdc8-e579c8375590 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:23.602964 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-cc99e09f-9ffe-4304-90f0-3ccb4acbef26 req-419c8c85-27cd-40c3-a5d7-4790f97ae66a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29dde975-c7d2-4621-9914-28ebf83c7285", "name": "network-vif-unplugged", "status": "completed", "tag": "49b5ba7a-7f54-4acc-8206-d942c4884181"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:45:23.612397 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-cc99e09f-9ffe-4304-90f0-3ccb4acbef26 req-419c8c85-27cd-40c3-a5d7-4790f97ae66a service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:23.612843 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-cc99e09f-9ffe-4304-90f0-3ccb4acbef26 req-419c8c85-27cd-40c3-a5d7-4790f97ae66a service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:23.625796 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.compute.server_external_events [req-cc99e09f-9ffe-4304-90f0-3ccb4acbef26 req-419c8c85-27cd-40c3-a5d7-4790f97ae66a service nova] Unable to find a host for instance 29dde975-c7d2-4621-9914-28ebf83c7285. Dropping event network-vif-unplugged {{(pid=123773) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 11 16:45:23.626694 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-cc99e09f-9ffe-4304-90f0-3ccb4acbef26 req-419c8c85-27cd-40c3-a5d7-4790f97ae66a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028340 Apr 11 16:45:23.627465 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 443/868] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 11 16:45:23.697182 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8d5964b1-a23d-4045-bdc8-e579c8375590 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:23.705379 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8d5964b1-a23d-4045-bdc8-e579c8375590 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:23.706846 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8d5964b1-a23d-4045-bdc8-e579c8375590 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:23.708027 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-8d5964b1-a23d-4045-bdc8-e579c8375590 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1664 microversion: 2.20 time: 0.168632 Apr 11 16:45:23.708588 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 426/869] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:23 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1664 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:23.726190 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-76fffe5e-2b85-49b2-ab40-a6f4da606957 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "134f10cd-d681-44af-bb40-ae74960bf151"}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:45:23.727287 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-76fffe5e-2b85-49b2-ab40-a6f4da606957 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:23.733572 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-76fffe5e-2b85-49b2-ab40-a6f4da606957 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:23.734010 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-76fffe5e-2b85-49b2-ab40-a6f4da606957 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:23.734783 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-76fffe5e-2b85-49b2-ab40-a6f4da606957 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:23.735195 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-76fffe5e-2b85-49b2-ab40-a6f4da606957 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:24.031530 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-76fffe5e-2b85-49b2-ab40-a6f4da606957 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "POST /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.309330 Apr 11 16:45:24.032930 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 444/870] 10.222.0.65 () {62 vars in 1363 bytes} [Mon Apr 11 16:45:23 2022] POST /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285/os-volume_attachments => generated 188 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 16:45:24.153621 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f3c86174-20e9-4f2b-bd17-57e5e10ed443 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:24.154126 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f3c86174-20e9-4f2b-bd17-57e5e10ed443 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:24.160190 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f3c86174-20e9-4f2b-bd17-57e5e10ed443 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:24.160660 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f3c86174-20e9-4f2b-bd17-57e5e10ed443 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:24.161381 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f3c86174-20e9-4f2b-bd17-57e5e10ed443 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:24.161804 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f3c86174-20e9-4f2b-bd17-57e5e10ed443 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:24.402159 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f3c86174-20e9-4f2b-bd17-57e5e10ed443 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "DELETE /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285/os-volume_attachments/134f10cd-d681-44af-bb40-ae74960bf151" status: 202 len: 0 microversion: 2.20 time: 0.252393 Apr 11 16:45:24.402958 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 427/871] 10.222.0.65 () {60 vars in 1456 bytes} [Mon Apr 11 16:45:24 2022] DELETE /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285/os-volume_attachments/134f10cd-d681-44af-bb40-ae74960bf151 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:45:24.461237 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-e7452bc7-d27f-49f9-8c9e-ae5993b885f1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:45:24.461781 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-e7452bc7-d27f-49f9-8c9e-ae5993b885f1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:24.468192 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e7452bc7-d27f-49f9-8c9e-ae5993b885f1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:24.468630 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e7452bc7-d27f-49f9-8c9e-ae5993b885f1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:24.469395 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e7452bc7-d27f-49f9-8c9e-ae5993b885f1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:24.469822 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e7452bc7-d27f-49f9-8c9e-ae5993b885f1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:24.551757 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-e7452bc7-d27f-49f9-8c9e-ae5993b885f1 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "POST /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285/action" status: 202 len: 0 microversion: 2.20 time: 0.094594 Apr 11 16:45:24.555316 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 445/872] 10.222.0.65 () {62 vars in 1318 bytes} [Mon Apr 11 16:45:24 2022] POST /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:45:24.560583 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-1ba40c31-c7fa-4f18-8189-26af3dcb8488 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:24.561254 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-1ba40c31-c7fa-4f18-8189-26af3dcb8488 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:24.568446 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1ba40c31-c7fa-4f18-8189-26af3dcb8488 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:24.569128 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1ba40c31-c7fa-4f18-8189-26af3dcb8488 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:24.570250 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1ba40c31-c7fa-4f18-8189-26af3dcb8488 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:24.570946 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1ba40c31-c7fa-4f18-8189-26af3dcb8488 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:24.720059 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-1ba40c31-c7fa-4f18-8189-26af3dcb8488 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:24.731448 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-1ba40c31-c7fa-4f18-8189-26af3dcb8488 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:24.732988 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-1ba40c31-c7fa-4f18-8189-26af3dcb8488 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:24.734156 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-1ba40c31-c7fa-4f18-8189-26af3dcb8488 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1672 microversion: 2.20 time: 0.177558 Apr 11 16:45:24.734770 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 428/873] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:24 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1672 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:25.754087 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-8b0410ef-123c-4f74-8dd4-fb3cf15ea69c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:25.754674 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-8b0410ef-123c-4f74-8dd4-fb3cf15ea69c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:25.762004 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8b0410ef-123c-4f74-8dd4-fb3cf15ea69c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:25.762547 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8b0410ef-123c-4f74-8dd4-fb3cf15ea69c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:25.763347 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8b0410ef-123c-4f74-8dd4-fb3cf15ea69c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:25.763807 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8b0410ef-123c-4f74-8dd4-fb3cf15ea69c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:25.903130 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-8b0410ef-123c-4f74-8dd4-fb3cf15ea69c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:25.911677 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-8b0410ef-123c-4f74-8dd4-fb3cf15ea69c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:25.913259 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-8b0410ef-123c-4f74-8dd4-fb3cf15ea69c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:25.914424 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-8b0410ef-123c-4f74-8dd4-fb3cf15ea69c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1730 microversion: 2.20 time: 0.164928 Apr 11 16:45:25.914980 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 446/874] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:25 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:26.933013 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ce3d31dc-eb34-4143-88f8-4434c736b0eb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:26.933666 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ce3d31dc-eb34-4143-88f8-4434c736b0eb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:26.940734 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ce3d31dc-eb34-4143-88f8-4434c736b0eb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:26.941254 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ce3d31dc-eb34-4143-88f8-4434c736b0eb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:26.942500 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ce3d31dc-eb34-4143-88f8-4434c736b0eb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:26.942949 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ce3d31dc-eb34-4143-88f8-4434c736b0eb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:27.143927 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ce3d31dc-eb34-4143-88f8-4434c736b0eb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:27.154813 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ce3d31dc-eb34-4143-88f8-4434c736b0eb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:27.160452 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ce3d31dc-eb34-4143-88f8-4434c736b0eb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:27.161987 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ce3d31dc-eb34-4143-88f8-4434c736b0eb tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1730 microversion: 2.20 time: 0.233429 Apr 11 16:45:27.175924 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 429/875] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:26 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1730 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:28.181093 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3b55a8a4-a241-4c7d-a800-30e309ed82a9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:28.181843 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3b55a8a4-a241-4c7d-a800-30e309ed82a9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:28.189265 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3b55a8a4-a241-4c7d-a800-30e309ed82a9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:28.190253 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3b55a8a4-a241-4c7d-a800-30e309ed82a9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:28.191405 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3b55a8a4-a241-4c7d-a800-30e309ed82a9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:28.192171 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3b55a8a4-a241-4c7d-a800-30e309ed82a9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:28.341859 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3b55a8a4-a241-4c7d-a800-30e309ed82a9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:28.350624 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3b55a8a4-a241-4c7d-a800-30e309ed82a9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:28.352108 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3b55a8a4-a241-4c7d-a800-30e309ed82a9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:28.353282 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3b55a8a4-a241-4c7d-a800-30e309ed82a9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1730 microversion: 2.20 time: 0.176809 Apr 11 16:45:28.353843 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 447/876] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:28 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:29.374172 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5a925d94-bab9-4bfe-881b-809efedd51f9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:29.374172 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5a925d94-bab9-4bfe-881b-809efedd51f9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:29.381240 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5a925d94-bab9-4bfe-881b-809efedd51f9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:29.381679 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5a925d94-bab9-4bfe-881b-809efedd51f9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:29.382471 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5a925d94-bab9-4bfe-881b-809efedd51f9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:29.382917 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5a925d94-bab9-4bfe-881b-809efedd51f9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:29.531519 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5a925d94-bab9-4bfe-881b-809efedd51f9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:29.541284 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5a925d94-bab9-4bfe-881b-809efedd51f9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:29.542779 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5a925d94-bab9-4bfe-881b-809efedd51f9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:29.544104 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5a925d94-bab9-4bfe-881b-809efedd51f9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1730 microversion: 2.20 time: 0.175051 Apr 11 16:45:29.544907 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 430/877] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:29 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:30.562917 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-8256e173-eeb1-49ff-a3f8-512a35082ef9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:30.563560 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-8256e173-eeb1-49ff-a3f8-512a35082ef9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:30.573864 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8256e173-eeb1-49ff-a3f8-512a35082ef9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:30.576062 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8256e173-eeb1-49ff-a3f8-512a35082ef9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:30.576062 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8256e173-eeb1-49ff-a3f8-512a35082ef9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:30.576062 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8256e173-eeb1-49ff-a3f8-512a35082ef9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:30.729554 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-8256e173-eeb1-49ff-a3f8-512a35082ef9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:30.743146 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-8256e173-eeb1-49ff-a3f8-512a35082ef9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:30.746183 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-8256e173-eeb1-49ff-a3f8-512a35082ef9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:30.748226 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-8256e173-eeb1-49ff-a3f8-512a35082ef9 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1730 microversion: 2.20 time: 0.189358 Apr 11 16:45:30.749185 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 448/878] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:30 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:31.284348 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-06757cd5-3a51-4929-b1b1-f62702b6ebdb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:31.284996 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-06757cd5-3a51-4929-b1b1-f62702b6ebdb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:31.291922 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-06757cd5-3a51-4929-b1b1-f62702b6ebdb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:31.292373 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-06757cd5-3a51-4929-b1b1-f62702b6ebdb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:31.293165 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-06757cd5-3a51-4929-b1b1-f62702b6ebdb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:31.293600 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-06757cd5-3a51-4929-b1b1-f62702b6ebdb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:31.320283 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-06757cd5-3a51-4929-b1b1-f62702b6ebdb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/ips" status: 200 len: 147 microversion: 2.1 time: 0.039580 Apr 11 16:45:31.320897 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 431/879] 10.222.0.65 () {58 vars in 1247 bytes} [Mon Apr 11 16:45:31 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:45:31.768208 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-fb1de1f3-55bb-4d8c-bf4c-ee6d7618ba94 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:31.769579 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-fb1de1f3-55bb-4d8c-bf4c-ee6d7618ba94 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:31.777585 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fb1de1f3-55bb-4d8c-bf4c-ee6d7618ba94 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:31.778153 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fb1de1f3-55bb-4d8c-bf4c-ee6d7618ba94 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:31.779002 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fb1de1f3-55bb-4d8c-bf4c-ee6d7618ba94 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:31.779428 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-fb1de1f3-55bb-4d8c-bf4c-ee6d7618ba94 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:31.917513 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-fb1de1f3-55bb-4d8c-bf4c-ee6d7618ba94 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:31.926124 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-fb1de1f3-55bb-4d8c-bf4c-ee6d7618ba94 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:31.927666 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-fb1de1f3-55bb-4d8c-bf4c-ee6d7618ba94 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:31.928829 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-fb1de1f3-55bb-4d8c-bf4c-ee6d7618ba94 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1730 microversion: 2.20 time: 0.165310 Apr 11 16:45:31.929863 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 449/880] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:31 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:32.695129 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-87926b84-5b4a-4da5-b3db-a76fe5e8d1ab tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6da54726-302b-4e52-b616-3f9e4ec8e601"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:45:32.701414 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-87926b84-5b4a-4da5-b3db-a76fe5e8d1ab tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:32.708446 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-87926b84-5b4a-4da5-b3db-a76fe5e8d1ab tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:32.708985 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-87926b84-5b4a-4da5-b3db-a76fe5e8d1ab tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:32.709857 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-87926b84-5b4a-4da5-b3db-a76fe5e8d1ab tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:32.710363 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-87926b84-5b4a-4da5-b3db-a76fe5e8d1ab tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:32.948434 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ccf46404-a398-48b3-97cd-204aab68efba tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:32.948992 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ccf46404-a398-48b3-97cd-204aab68efba tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:32.955836 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ccf46404-a398-48b3-97cd-204aab68efba tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:32.956278 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ccf46404-a398-48b3-97cd-204aab68efba tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:32.957037 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ccf46404-a398-48b3-97cd-204aab68efba tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:32.957456 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ccf46404-a398-48b3-97cd-204aab68efba tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:33.105737 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ccf46404-a398-48b3-97cd-204aab68efba tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:33.114022 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ccf46404-a398-48b3-97cd-204aab68efba tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:33.115657 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ccf46404-a398-48b3-97cd-204aab68efba tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:33.119295 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ccf46404-a398-48b3-97cd-204aab68efba tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1730 microversion: 2.20 time: 0.175320 Apr 11 16:45:33.120557 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 450/881] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:32 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:45:34.310535 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-e899d52e-3e1b-4758-9bb4-e6e37413d5f2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:34.311796 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-e899d52e-3e1b-4758-9bb4-e6e37413d5f2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:34.322406 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e899d52e-3e1b-4758-9bb4-e6e37413d5f2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:34.323516 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e899d52e-3e1b-4758-9bb4-e6e37413d5f2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:34.325099 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e899d52e-3e1b-4758-9bb4-e6e37413d5f2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:34.326062 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e899d52e-3e1b-4758-9bb4-e6e37413d5f2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:34.485574 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-e899d52e-3e1b-4758-9bb4-e6e37413d5f2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:34.494777 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-e899d52e-3e1b-4758-9bb4-e6e37413d5f2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:34.496334 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-e899d52e-3e1b-4758-9bb4-e6e37413d5f2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:34.497705 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-e899d52e-3e1b-4758-9bb4-e6e37413d5f2 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1730 microversion: 2.20 time: 0.356370 Apr 11 16:45:34.498261 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 451/882] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:34 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1730 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:45:35.517613 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-2599fdcf-f06c-4956-9929-758848296ef4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:35.518585 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-2599fdcf-f06c-4956-9929-758848296ef4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:35.530904 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2599fdcf-f06c-4956-9929-758848296ef4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:35.531347 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2599fdcf-f06c-4956-9929-758848296ef4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:35.532184 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2599fdcf-f06c-4956-9929-758848296ef4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:35.532613 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2599fdcf-f06c-4956-9929-758848296ef4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:35.676046 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-2599fdcf-f06c-4956-9929-758848296ef4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:35.686801 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-2599fdcf-f06c-4956-9929-758848296ef4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:35.688649 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-2599fdcf-f06c-4956-9929-758848296ef4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:35.689915 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-2599fdcf-f06c-4956-9929-758848296ef4 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1730 microversion: 2.20 time: 0.176300 Apr 11 16:45:35.690519 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 452/883] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:35 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:36.708782 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1b350bb4-8441-4bc8-b785-0d7e3488ae9c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:36.709459 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1b350bb4-8441-4bc8-b785-0d7e3488ae9c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:36.716458 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1b350bb4-8441-4bc8-b785-0d7e3488ae9c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:36.717267 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1b350bb4-8441-4bc8-b785-0d7e3488ae9c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:36.717687 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1b350bb4-8441-4bc8-b785-0d7e3488ae9c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:36.718136 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1b350bb4-8441-4bc8-b785-0d7e3488ae9c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:36.852378 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1b350bb4-8441-4bc8-b785-0d7e3488ae9c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:36.860397 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1b350bb4-8441-4bc8-b785-0d7e3488ae9c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:36.861909 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1b350bb4-8441-4bc8-b785-0d7e3488ae9c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:36.863064 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1b350bb4-8441-4bc8-b785-0d7e3488ae9c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1730 microversion: 2.20 time: 0.158420 Apr 11 16:45:36.863620 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 453/884] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:36 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:37.881730 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-cfed6dec-13fd-4751-a1dc-8cf07910e00c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:37.882625 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-cfed6dec-13fd-4751-a1dc-8cf07910e00c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:37.889447 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cfed6dec-13fd-4751-a1dc-8cf07910e00c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:37.889887 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cfed6dec-13fd-4751-a1dc-8cf07910e00c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:37.890630 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cfed6dec-13fd-4751-a1dc-8cf07910e00c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:37.891071 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cfed6dec-13fd-4751-a1dc-8cf07910e00c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:38.032743 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-cfed6dec-13fd-4751-a1dc-8cf07910e00c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:38.044872 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-cfed6dec-13fd-4751-a1dc-8cf07910e00c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:38.046321 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-cfed6dec-13fd-4751-a1dc-8cf07910e00c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:38.047495 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-cfed6dec-13fd-4751-a1dc-8cf07910e00c tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1730 microversion: 2.20 time: 0.169790 Apr 11 16:45:38.048283 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 454/885] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:37 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 16:45:39.068227 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-8f5ce810-359f-4c1b-ab01-9b9a4f0aff71 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:39.069146 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-8f5ce810-359f-4c1b-ab01-9b9a4f0aff71 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:39.075989 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8f5ce810-359f-4c1b-ab01-9b9a4f0aff71 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:39.076438 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8f5ce810-359f-4c1b-ab01-9b9a4f0aff71 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:39.077220 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8f5ce810-359f-4c1b-ab01-9b9a4f0aff71 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:39.077664 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8f5ce810-359f-4c1b-ab01-9b9a4f0aff71 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:39.218356 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-8f5ce810-359f-4c1b-ab01-9b9a4f0aff71 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:39.226720 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-8f5ce810-359f-4c1b-ab01-9b9a4f0aff71 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:39.228256 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-8f5ce810-359f-4c1b-ab01-9b9a4f0aff71 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:39.229471 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-8f5ce810-359f-4c1b-ab01-9b9a4f0aff71 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1730 microversion: 2.20 time: 0.165233 Apr 11 16:45:39.230062 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 455/886] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:39 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:40.248360 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-17ad0e33-d88e-46d7-8678-7e7c437c2699 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:40.249063 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-17ad0e33-d88e-46d7-8678-7e7c437c2699 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:40.256013 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-17ad0e33-d88e-46d7-8678-7e7c437c2699 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:40.256464 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-17ad0e33-d88e-46d7-8678-7e7c437c2699 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:40.257488 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-17ad0e33-d88e-46d7-8678-7e7c437c2699 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:40.257921 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-17ad0e33-d88e-46d7-8678-7e7c437c2699 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:40.391408 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-17ad0e33-d88e-46d7-8678-7e7c437c2699 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:40.399626 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-17ad0e33-d88e-46d7-8678-7e7c437c2699 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:40.401143 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-17ad0e33-d88e-46d7-8678-7e7c437c2699 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:40.402278 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-17ad0e33-d88e-46d7-8678-7e7c437c2699 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1730 microversion: 2.20 time: 0.157930 Apr 11 16:45:40.402847 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 456/887] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:40 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:41.421138 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f35bbafc-1095-4820-992a-fd73a46ce195 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:41.421793 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f35bbafc-1095-4820-992a-fd73a46ce195 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:41.428609 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f35bbafc-1095-4820-992a-fd73a46ce195 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:41.429087 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f35bbafc-1095-4820-992a-fd73a46ce195 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:41.429858 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f35bbafc-1095-4820-992a-fd73a46ce195 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:41.430299 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f35bbafc-1095-4820-992a-fd73a46ce195 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:41.562492 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f35bbafc-1095-4820-992a-fd73a46ce195 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:41.571143 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f35bbafc-1095-4820-992a-fd73a46ce195 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:41.572705 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f35bbafc-1095-4820-992a-fd73a46ce195 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:41.573881 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f35bbafc-1095-4820-992a-fd73a46ce195 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1730 microversion: 2.20 time: 0.156909 Apr 11 16:45:41.574450 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 457/888] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:41 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:42.592496 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-dc296a17-3bc9-4c18-8396-6166b408e91b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:42.593221 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-dc296a17-3bc9-4c18-8396-6166b408e91b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:42.599952 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dc296a17-3bc9-4c18-8396-6166b408e91b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:42.600588 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dc296a17-3bc9-4c18-8396-6166b408e91b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:42.601385 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dc296a17-3bc9-4c18-8396-6166b408e91b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:42.601817 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dc296a17-3bc9-4c18-8396-6166b408e91b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:42.734532 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-dc296a17-3bc9-4c18-8396-6166b408e91b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:42.744200 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-dc296a17-3bc9-4c18-8396-6166b408e91b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:42.745702 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-dc296a17-3bc9-4c18-8396-6166b408e91b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:42.746858 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-dc296a17-3bc9-4c18-8396-6166b408e91b tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1730 microversion: 2.20 time: 0.158444 Apr 11 16:45:42.747438 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 458/889] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:42 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:43.350931 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-87926b84-5b4a-4da5-b3db-a76fe5e8d1ab tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "POST /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.660078 Apr 11 16:45:43.351758 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 432/890] 10.222.0.65 () {60 vars in 1322 bytes} [Mon Apr 11 16:45:32 2022] POST /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments => generated 194 bytes in 10662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:45:43.765383 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-04131e5a-4683-430a-a97a-9daf0dd8a355 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:43.765988 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-04131e5a-4683-430a-a97a-9daf0dd8a355 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:43.773371 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-04131e5a-4683-430a-a97a-9daf0dd8a355 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:43.773818 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-04131e5a-4683-430a-a97a-9daf0dd8a355 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:43.775217 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-04131e5a-4683-430a-a97a-9daf0dd8a355 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:43.775944 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-04131e5a-4683-430a-a97a-9daf0dd8a355 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:43.911966 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-04131e5a-4683-430a-a97a-9daf0dd8a355 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:43.920636 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-04131e5a-4683-430a-a97a-9daf0dd8a355 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:43.922142 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-04131e5a-4683-430a-a97a-9daf0dd8a355 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:43.923348 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-04131e5a-4683-430a-a97a-9daf0dd8a355 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1730 microversion: 2.20 time: 0.162063 Apr 11 16:45:43.923912 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 459/891] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:43 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:44.942986 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-b09f5709-41c1-46eb-8854-71eeae170745 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:44.943657 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-b09f5709-41c1-46eb-8854-71eeae170745 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:44.951197 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b09f5709-41c1-46eb-8854-71eeae170745 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:44.951670 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b09f5709-41c1-46eb-8854-71eeae170745 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:44.952550 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b09f5709-41c1-46eb-8854-71eeae170745 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:44.952891 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b09f5709-41c1-46eb-8854-71eeae170745 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:45.088651 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-b09f5709-41c1-46eb-8854-71eeae170745 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:45.097100 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-b09f5709-41c1-46eb-8854-71eeae170745 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:45.098596 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-b09f5709-41c1-46eb-8854-71eeae170745 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:45.099787 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-b09f5709-41c1-46eb-8854-71eeae170745 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1730 microversion: 2.20 time: 0.161635 Apr 11 16:45:45.100351 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 433/892] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:44 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:45.749495 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-a0380af8-3972-4819-aed5-91038d4516c5 req-d9400370-3885-445a-ab5f-f5dbb4d3ce53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29dde975-c7d2-4621-9914-28ebf83c7285", "name": "network-vif-plugged", "status": "completed", "tag": "49b5ba7a-7f54-4acc-8206-d942c4884181"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:45:45.758686 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-a0380af8-3972-4819-aed5-91038d4516c5 req-d9400370-3885-445a-ab5f-f5dbb4d3ce53 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:45.759133 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-a0380af8-3972-4819-aed5-91038d4516c5 req-d9400370-3885-445a-ab5f-f5dbb4d3ce53 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:45.770868 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-a0380af8-3972-4819-aed5-91038d4516c5 req-d9400370-3885-445a-ab5f-f5dbb4d3ce53 service nova] Creating event network-vif-plugged:49b5ba7a-7f54-4acc-8206-d942c4884181 for instance 29dde975-c7d2-4621-9914-28ebf83c7285 on hv-cinder-83716 Apr 11 16:45:45.776543 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-a0380af8-3972-4819-aed5-91038d4516c5 req-d9400370-3885-445a-ab5f-f5dbb4d3ce53 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030587 Apr 11 16:45:45.777337 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 460/893] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:45:46.119409 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ab7d1abd-d350-4f74-ac39-b0a971c96585 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:46.120103 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ab7d1abd-d350-4f74-ac39-b0a971c96585 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:46.127465 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ab7d1abd-d350-4f74-ac39-b0a971c96585 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:46.127955 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ab7d1abd-d350-4f74-ac39-b0a971c96585 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:46.128832 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ab7d1abd-d350-4f74-ac39-b0a971c96585 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:46.129898 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ab7d1abd-d350-4f74-ac39-b0a971c96585 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:46.271198 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ab7d1abd-d350-4f74-ac39-b0a971c96585 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:46.282226 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ab7d1abd-d350-4f74-ac39-b0a971c96585 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:46.283923 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ab7d1abd-d350-4f74-ac39-b0a971c96585 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:46.285081 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ab7d1abd-d350-4f74-ac39-b0a971c96585 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1730 microversion: 2.20 time: 0.170470 Apr 11 16:45:46.285650 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 434/894] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:46 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:47.305367 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3be8a99a-b2ef-4406-b6fe-3806e4dbf04d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:47.305927 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3be8a99a-b2ef-4406-b6fe-3806e4dbf04d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:47.313028 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3be8a99a-b2ef-4406-b6fe-3806e4dbf04d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:47.313474 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3be8a99a-b2ef-4406-b6fe-3806e4dbf04d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:47.314250 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3be8a99a-b2ef-4406-b6fe-3806e4dbf04d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:47.314680 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3be8a99a-b2ef-4406-b6fe-3806e4dbf04d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:47.447449 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3be8a99a-b2ef-4406-b6fe-3806e4dbf04d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:47.455886 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3be8a99a-b2ef-4406-b6fe-3806e4dbf04d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:47.457387 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3be8a99a-b2ef-4406-b6fe-3806e4dbf04d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:47.458555 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3be8a99a-b2ef-4406-b6fe-3806e4dbf04d tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1730 microversion: 2.20 time: 0.158269 Apr 11 16:45:47.459128 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 461/895] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:47 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:48.476776 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-21b6b325-b0fd-488c-ade2-7fd6fd10e426 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:48.477348 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-21b6b325-b0fd-488c-ade2-7fd6fd10e426 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:48.484157 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-21b6b325-b0fd-488c-ade2-7fd6fd10e426 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:48.484603 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-21b6b325-b0fd-488c-ade2-7fd6fd10e426 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:48.485390 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-21b6b325-b0fd-488c-ade2-7fd6fd10e426 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:48.485810 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-21b6b325-b0fd-488c-ade2-7fd6fd10e426 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:48.624298 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-21b6b325-b0fd-488c-ade2-7fd6fd10e426 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:48.632877 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-21b6b325-b0fd-488c-ade2-7fd6fd10e426 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:48.634413 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-21b6b325-b0fd-488c-ade2-7fd6fd10e426 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:48.635818 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-21b6b325-b0fd-488c-ade2-7fd6fd10e426 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1730 microversion: 2.20 time: 0.163139 Apr 11 16:45:48.636532 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 435/896] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:48 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:49.654735 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-77eebeb0-cfb3-444a-b6a7-344c5366654e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:49.655367 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-77eebeb0-cfb3-444a-b6a7-344c5366654e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:49.662019 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-77eebeb0-cfb3-444a-b6a7-344c5366654e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:49.662517 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-77eebeb0-cfb3-444a-b6a7-344c5366654e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:49.663263 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-77eebeb0-cfb3-444a-b6a7-344c5366654e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:49.663750 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-77eebeb0-cfb3-444a-b6a7-344c5366654e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:49.799115 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-77eebeb0-cfb3-444a-b6a7-344c5366654e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:49.808772 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-77eebeb0-cfb3-444a-b6a7-344c5366654e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:49.810249 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-77eebeb0-cfb3-444a-b6a7-344c5366654e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:45:49.811404 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-77eebeb0-cfb3-444a-b6a7-344c5366654e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1717 microversion: 2.20 time: 0.160763 Apr 11 16:45:49.812027 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 462/897] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:45:49 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:45:50.864471 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-192c5bae-ef63-4c3f-816e-7ce13be70928 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:50.865476 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-192c5bae-ef63-4c3f-816e-7ce13be70928 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:50.872351 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-192c5bae-ef63-4c3f-816e-7ce13be70928 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:50.872802 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-192c5bae-ef63-4c3f-816e-7ce13be70928 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:50.873558 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-192c5bae-ef63-4c3f-816e-7ce13be70928 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:50.873985 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-192c5bae-ef63-4c3f-816e-7ce13be70928 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:50.903165 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-192c5bae-ef63-4c3f-816e-7ce13be70928 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042846 Apr 11 16:45:50.903733 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 436/898] 10.222.0.65 () {58 vars in 1301 bytes} [Mon Apr 11 16:45:50 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:45:50.914259 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-709b3252-48ee-4025-a1f3-3f660172f921 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:45:50.914801 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-709b3252-48ee-4025-a1f3-3f660172f921 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:50.921704 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-709b3252-48ee-4025-a1f3-3f660172f921 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:50.922156 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-709b3252-48ee-4025-a1f3-3f660172f921 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:50.922930 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-709b3252-48ee-4025-a1f3-3f660172f921 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:50.923366 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-709b3252-48ee-4025-a1f3-3f660172f921 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:50.953790 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-709b3252-48ee-4025-a1f3-3f660172f921 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments/6da54726-302b-4e52-b616-3f9e4ec8e601" status: 200 len: 194 microversion: 2.1 time: 0.043540 Apr 11 16:45:50.954390 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 463/899] 10.222.0.65 () {58 vars in 1412 bytes} [Mon Apr 11 16:45:50 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments/6da54726-302b-4e52-b616-3f9e4ec8e601 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:45:52.304376 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5014ac10-6b74-4fc0-9e87-694eb129a4bb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "639a0aa7-29ae-4c66-837e-a7a00ddfdcf3"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:45:52.305434 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5014ac10-6b74-4fc0-9e87-694eb129a4bb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:45:52.312366 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5014ac10-6b74-4fc0-9e87-694eb129a4bb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:52.312836 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5014ac10-6b74-4fc0-9e87-694eb129a4bb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:52.313611 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5014ac10-6b74-4fc0-9e87-694eb129a4bb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:45:52.314045 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5014ac10-6b74-4fc0-9e87-694eb129a4bb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:45:52.564731 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5014ac10-6b74-4fc0-9e87-694eb129a4bb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "POST /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264295 Apr 11 16:45:52.565529 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 437/900] 10.222.0.65 () {60 vars in 1322 bytes} [Mon Apr 11 16:45:52 2022] POST /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:46:00.161783 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-2f0bf2ad-9355-4938-a960-91bb68ed3215 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:00.163323 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-2f0bf2ad-9355-4938-a960-91bb68ed3215 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:00.170008 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2f0bf2ad-9355-4938-a960-91bb68ed3215 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:00.170488 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2f0bf2ad-9355-4938-a960-91bb68ed3215 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:00.171294 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2f0bf2ad-9355-4938-a960-91bb68ed3215 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:00.171772 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2f0bf2ad-9355-4938-a960-91bb68ed3215 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:00.219570 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-2f0bf2ad-9355-4938-a960-91bb68ed3215 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.063189 Apr 11 16:46:00.220215 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 464/901] 10.222.0.65 () {58 vars in 1301 bytes} [Mon Apr 11 16:46:00 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments => generated 371 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:46:00.382570 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5cb7b7c7-48cd-46f7-97e7-60e3e0f4b0eb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:00.383423 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5cb7b7c7-48cd-46f7-97e7-60e3e0f4b0eb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:00.394386 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5cb7b7c7-48cd-46f7-97e7-60e3e0f4b0eb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:00.395164 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5cb7b7c7-48cd-46f7-97e7-60e3e0f4b0eb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:00.396624 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5cb7b7c7-48cd-46f7-97e7-60e3e0f4b0eb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:00.397448 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5cb7b7c7-48cd-46f7-97e7-60e3e0f4b0eb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:00.434770 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5cb7b7c7-48cd-46f7-97e7-60e3e0f4b0eb tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments/6da54726-302b-4e52-b616-3f9e4ec8e601" status: 200 len: 194 microversion: 2.1 time: 0.061435 Apr 11 16:46:00.435757 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 438/902] 10.222.0.65 () {58 vars in 1412 bytes} [Mon Apr 11 16:46:00 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments/6da54726-302b-4e52-b616-3f9e4ec8e601 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:46:00.447557 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-792446d0-cc80-4b26-8db8-f71e51e899cc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:00.448184 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-792446d0-cc80-4b26-8db8-f71e51e899cc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:00.455252 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-792446d0-cc80-4b26-8db8-f71e51e899cc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:00.455725 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-792446d0-cc80-4b26-8db8-f71e51e899cc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:00.456627 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-792446d0-cc80-4b26-8db8-f71e51e899cc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:00.457062 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-792446d0-cc80-4b26-8db8-f71e51e899cc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:00.580920 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.objects.instance [None req-792446d0-cc80-4b26-8db8-f71e51e899cc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lazy-loading 'services' on Instance uuid 04a90907-9122-446d-899b-e931d741f29a {{(pid=123773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:46:00.672716 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-792446d0-cc80-4b26-8db8-f71e51e899cc tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "DELETE /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments/6da54726-302b-4e52-b616-3f9e4ec8e601" status: 202 len: 0 microversion: 2.1 time: 0.229718 Apr 11 16:46:00.673417 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 465/903] 10.222.0.65 () {58 vars in 1415 bytes} [Mon Apr 11 16:46:00 2022] DELETE /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments/6da54726-302b-4e52-b616-3f9e4ec8e601 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:46:02.860392 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f4631e04-02fa-4214-af91-9a44047685d0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:02.861035 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f4631e04-02fa-4214-af91-9a44047685d0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:02.868360 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f4631e04-02fa-4214-af91-9a44047685d0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:02.868810 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f4631e04-02fa-4214-af91-9a44047685d0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:02.869596 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f4631e04-02fa-4214-af91-9a44047685d0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:02.870001 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f4631e04-02fa-4214-af91-9a44047685d0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:02.900061 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f4631e04-02fa-4214-af91-9a44047685d0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments/639a0aa7-29ae-4c66-837e-a7a00ddfdcf3" status: 200 len: 194 microversion: 2.1 time: 0.043733 Apr 11 16:46:02.900681 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 439/904] 10.222.0.65 () {58 vars in 1412 bytes} [Mon Apr 11 16:46:02 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments/639a0aa7-29ae-4c66-837e-a7a00ddfdcf3 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:46:02.911351 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1cce7940-e738-40c9-b2f6-f70e71ff8d9e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:02.912376 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1cce7940-e738-40c9-b2f6-f70e71ff8d9e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:02.919238 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1cce7940-e738-40c9-b2f6-f70e71ff8d9e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:02.919737 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1cce7940-e738-40c9-b2f6-f70e71ff8d9e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:02.920521 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1cce7940-e738-40c9-b2f6-f70e71ff8d9e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:02.920968 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1cce7940-e738-40c9-b2f6-f70e71ff8d9e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:03.008477 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.objects.instance [None req-1cce7940-e738-40c9-b2f6-f70e71ff8d9e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lazy-loading 'services' on Instance uuid 04a90907-9122-446d-899b-e931d741f29a {{(pid=123773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:46:03.097635 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1cce7940-e738-40c9-b2f6-f70e71ff8d9e tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "DELETE /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments/639a0aa7-29ae-4c66-837e-a7a00ddfdcf3" status: 202 len: 0 microversion: 2.1 time: 0.190375 Apr 11 16:46:03.098263 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 466/905] 10.222.0.65 () {58 vars in 1415 bytes} [Mon Apr 11 16:46:02 2022] DELETE /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments/639a0aa7-29ae-4c66-837e-a7a00ddfdcf3 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:46:04.279879 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d20ea56e-437f-4ee4-9a6b-8e8e7e0fccda tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:04.280916 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d20ea56e-437f-4ee4-9a6b-8e8e7e0fccda tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:04.289449 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d20ea56e-437f-4ee4-9a6b-8e8e7e0fccda tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:04.289775 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d20ea56e-437f-4ee4-9a6b-8e8e7e0fccda tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:04.290618 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d20ea56e-437f-4ee4-9a6b-8e8e7e0fccda tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:04.291050 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d20ea56e-437f-4ee4-9a6b-8e8e7e0fccda tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:04.325511 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d20ea56e-437f-4ee4-9a6b-8e8e7e0fccda tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049980 Apr 11 16:46:04.326140 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 440/906] 10.222.0.65 () {58 vars in 1301 bytes} [Mon Apr 11 16:46:04 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 16:46:04.455420 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ae87275d-6a98-4226-893d-b272e9ae642a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:04.456662 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ae87275d-6a98-4226-893d-b272e9ae642a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:04.464204 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ae87275d-6a98-4226-893d-b272e9ae642a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:04.464633 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ae87275d-6a98-4226-893d-b272e9ae642a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:04.465437 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ae87275d-6a98-4226-893d-b272e9ae642a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:04.465844 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ae87275d-6a98-4226-893d-b272e9ae642a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:04.500902 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ae87275d-6a98-4226-893d-b272e9ae642a tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050553 Apr 11 16:46:04.501506 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 467/907] 10.222.0.65 () {58 vars in 1301 bytes} [Mon Apr 11 16:46:04 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 16:46:04.563700 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a121f12f-b2f8-426a-806c-eb78f9887ea9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:04.564211 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a121f12f-b2f8-426a-806c-eb78f9887ea9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:04.570460 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a121f12f-b2f8-426a-806c-eb78f9887ea9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:04.570898 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a121f12f-b2f8-426a-806c-eb78f9887ea9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:04.571690 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a121f12f-b2f8-426a-806c-eb78f9887ea9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:04.572120 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a121f12f-b2f8-426a-806c-eb78f9887ea9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:04.599497 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a121f12f-b2f8-426a-806c-eb78f9887ea9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Going to try to terminate instance {{(pid=123774) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:46:04.684613 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a121f12f-b2f8-426a-806c-eb78f9887ea9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "DELETE /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 204 len: 0 microversion: 2.1 time: 0.124107 Apr 11 16:46:04.685534 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 441/908] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:46:04 2022] DELETE /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:46:04.695226 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-26e13bec-8ea2-4e5b-8356-1cf769d69313 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:04.695861 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-26e13bec-8ea2-4e5b-8356-1cf769d69313 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:04.701939 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-26e13bec-8ea2-4e5b-8356-1cf769d69313 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:04.702378 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-26e13bec-8ea2-4e5b-8356-1cf769d69313 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:04.703134 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-26e13bec-8ea2-4e5b-8356-1cf769d69313 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:04.703557 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-26e13bec-8ea2-4e5b-8356-1cf769d69313 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:04.842118 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-26e13bec-8ea2-4e5b-8356-1cf769d69313 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:04.849830 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-26e13bec-8ea2-4e5b-8356-1cf769d69313 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 200 len: 1676 microversion: 2.1 time: 0.158585 Apr 11 16:46:04.850388 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 468/909] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:46:04 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:46:05.868275 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-524c11b6-309d-42dc-a521-06d7809f7b57 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:05.868948 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-524c11b6-309d-42dc-a521-06d7809f7b57 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:05.875882 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-524c11b6-309d-42dc-a521-06d7809f7b57 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:05.876327 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-524c11b6-309d-42dc-a521-06d7809f7b57 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:05.877114 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-524c11b6-309d-42dc-a521-06d7809f7b57 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:05.877542 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-524c11b6-309d-42dc-a521-06d7809f7b57 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:06.010673 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-524c11b6-309d-42dc-a521-06d7809f7b57 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:06.018704 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-524c11b6-309d-42dc-a521-06d7809f7b57 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 200 len: 1676 microversion: 2.1 time: 0.155418 Apr 11 16:46:06.019292 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 442/910] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:46:05 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:46:07.038247 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-a8fe1130-5185-4799-acb0-8162b85226a6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:07.038941 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-a8fe1130-5185-4799-acb0-8162b85226a6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:07.045734 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a8fe1130-5185-4799-acb0-8162b85226a6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:07.046177 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a8fe1130-5185-4799-acb0-8162b85226a6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:07.046947 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a8fe1130-5185-4799-acb0-8162b85226a6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:07.047377 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-a8fe1130-5185-4799-acb0-8162b85226a6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:07.556648 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-a8fe1130-5185-4799-acb0-8162b85226a6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:07.564605 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-a8fe1130-5185-4799-acb0-8162b85226a6 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 200 len: 1676 microversion: 2.1 time: 0.530252 Apr 11 16:46:07.565215 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 469/911] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:46:07 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 1676 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:46:08.132379 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-491d7d9e-575e-4e29-9789-9a35a9411ad7 req-7567915b-cadd-4c3f-8335-6079d24114f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a90907-9122-446d-899b-e931d741f29a", "name": "network-vif-deleted", "tag": "3f96714c-7163-450a-9a97-c521d3e339cf"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:46:08.144383 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-491d7d9e-575e-4e29-9789-9a35a9411ad7 req-7567915b-cadd-4c3f-8335-6079d24114f1 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:08.145931 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-491d7d9e-575e-4e29-9789-9a35a9411ad7 req-7567915b-cadd-4c3f-8335-6079d24114f1 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:08.164603 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-491d7d9e-575e-4e29-9789-9a35a9411ad7 req-7567915b-cadd-4c3f-8335-6079d24114f1 service nova] Creating event network-vif-deleted:3f96714c-7163-450a-9a97-c521d3e339cf for instance 04a90907-9122-446d-899b-e931d741f29a on hv-cinder-83716 Apr 11 16:46:08.170698 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-491d7d9e-575e-4e29-9789-9a35a9411ad7 req-7567915b-cadd-4c3f-8335-6079d24114f1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042168 Apr 11 16:46:08.172072 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 443/912] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:46:08.583379 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-6f318a48-7570-4cb6-a2a4-87338b6b8da9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:08.584985 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-6f318a48-7570-4cb6-a2a4-87338b6b8da9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:08.592297 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6f318a48-7570-4cb6-a2a4-87338b6b8da9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:08.593033 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6f318a48-7570-4cb6-a2a4-87338b6b8da9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:08.593803 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6f318a48-7570-4cb6-a2a4-87338b6b8da9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:08.594280 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6f318a48-7570-4cb6-a2a4-87338b6b8da9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:08.632886 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6f318a48-7570-4cb6-a2a4-87338b6b8da9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:08.633336 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6f318a48-7570-4cb6-a2a4-87338b6b8da9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:08.633788 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.objects.instance [None req-6f318a48-7570-4cb6-a2a4-87338b6b8da9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lazy-loading 'fault' on Instance uuid 04a90907-9122-446d-899b-e931d741f29a {{(pid=123773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:46:08.677500 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6f318a48-7570-4cb6-a2a4-87338b6b8da9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd94b4c03d94440e7b92ea1051cb3625e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90215ff8d2af4f1fa9d0137fcb2f881d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:08.685152 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-6f318a48-7570-4cb6-a2a4-87338b6b8da9 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 200 len: 1328 microversion: 2.1 time: 0.106354 Apr 11 16:46:08.685686 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 470/913] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:46:08 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 1328 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:46:09.703684 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-2daf5c1a-291f-4263-8475-cba8afdf8543 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:09.704405 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-2daf5c1a-291f-4263-8475-cba8afdf8543 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:09.711421 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2daf5c1a-291f-4263-8475-cba8afdf8543 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:09.711900 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2daf5c1a-291f-4263-8475-cba8afdf8543 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:09.712667 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2daf5c1a-291f-4263-8475-cba8afdf8543 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:09.713091 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2daf5c1a-291f-4263-8475-cba8afdf8543 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:09.727221 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-2daf5c1a-291f-4263-8475-cba8afdf8543 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] HTTP exception thrown: Instance 04a90907-9122-446d-899b-e931d741f29a could not be found. Apr 11 16:46:09.727836 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-2daf5c1a-291f-4263-8475-cba8afdf8543 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Returning 404 to user: Instance 04a90907-9122-446d-899b-e931d741f29a could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:46:09.728679 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-2daf5c1a-291f-4263-8475-cba8afdf8543 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 404 len: 111 microversion: 2.1 time: 0.029771 Apr 11 16:46:09.729252 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 444/914] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:46:09 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:46:09.738136 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-be7bd83d-2bb1-4020-878f-db3b819f9de0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '.version_select at 0x7f741c045160>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:09.759499 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-be7bd83d-2bb1-4020-878f-db3b819f9de0 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1945945232" status: 202 len: 0 microversion: 2.1 time: 0.025198 Apr 11 16:46:09.760100 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 471/915] 10.222.0.65 () {58 vars in 1220 bytes} [Mon Apr 11 16:46:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1945945232 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:46:12.700766 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ffe00be2-a896-4697-9c35-1e9910d558a1 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:12.701556 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ffe00be2-a896-4697-9c35-1e9910d558a1 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:12.709546 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ffe00be2-a896-4697-9c35-1e9910d558a1 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:12.709546 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ffe00be2-a896-4697-9c35-1e9910d558a1 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:12.710348 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ffe00be2-a896-4697-9c35-1e9910d558a1 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:12.710787 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ffe00be2-a896-4697-9c35-1e9910d558a1 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:12.726479 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-ffe00be2-a896-4697-9c35-1e9910d558a1 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] HTTP exception thrown: Instance 04a90907-9122-446d-899b-e931d741f29a could not be found. Apr 11 16:46:12.727084 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ffe00be2-a896-4697-9c35-1e9910d558a1 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Returning 404 to user: Instance 04a90907-9122-446d-899b-e931d741f29a could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:46:12.727966 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ffe00be2-a896-4697-9c35-1e9910d558a1 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "DELETE /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 404 len: 111 microversion: 2.1 time: 0.031724 Apr 11 16:46:12.728551 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 445/916] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:46:12 2022] DELETE /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:46:12.737360 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1a8b21ec-0064-4d1d-92d4-f5f2c713a472 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:12.737963 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1a8b21ec-0064-4d1d-92d4-f5f2c713a472 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 04a90907-9122-446d-899b-e931d741f29a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:12.745625 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1a8b21ec-0064-4d1d-92d4-f5f2c713a472 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:12.746068 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1a8b21ec-0064-4d1d-92d4-f5f2c713a472 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:12.746851 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1a8b21ec-0064-4d1d-92d4-f5f2c713a472 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:12.747287 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1a8b21ec-0064-4d1d-92d4-f5f2c713a472 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:12.762725 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-1a8b21ec-0064-4d1d-92d4-f5f2c713a472 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] HTTP exception thrown: Instance 04a90907-9122-446d-899b-e931d741f29a could not be found. Apr 11 16:46:12.763366 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1a8b21ec-0064-4d1d-92d4-f5f2c713a472 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Returning 404 to user: Instance 04a90907-9122-446d-899b-e931d741f29a could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:46:12.764332 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1a8b21ec-0064-4d1d-92d4-f5f2c713a472 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a" status: 404 len: 111 microversion: 2.1 time: 0.031543 Apr 11 16:46:12.764982 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 472/917] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:46:12 2022] GET /compute/v2.1/servers/04a90907-9122-446d-899b-e931d741f29a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:46:13.928688 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-799150d4-265e-444b-9548-806ae37aa819 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:13.929325 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-799150d4-265e-444b-9548-806ae37aa819 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:13.936236 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-799150d4-265e-444b-9548-806ae37aa819 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:13.936680 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-799150d4-265e-444b-9548-806ae37aa819 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:13.937460 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-799150d4-265e-444b-9548-806ae37aa819 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:13.937891 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-799150d4-265e-444b-9548-806ae37aa819 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:13.955361 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-799150d4-265e-444b-9548-806ae37aa819 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] HTTP exception thrown: Instance 0db1c6a9-bc5a-45f7-bbd3-590292385768 could not be found. Apr 11 16:46:13.955997 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-799150d4-265e-444b-9548-806ae37aa819 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Returning 404 to user: Instance 0db1c6a9-bc5a-45f7-bbd3-590292385768 could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:46:13.956858 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-799150d4-265e-444b-9548-806ae37aa819 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 404 len: 111 microversion: 2.1 time: 0.032559 Apr 11 16:46:13.957425 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 446/918] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:46:13 2022] DELETE /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:46:13.967369 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-36097cc9-8e87-4307-939a-626bb638d3e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:13.968037 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-36097cc9-8e87-4307-939a-626bb638d3e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] [instance: 0db1c6a9-bc5a-45f7-bbd3-590292385768] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:13.975288 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-36097cc9-8e87-4307-939a-626bb638d3e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:13.975776 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-36097cc9-8e87-4307-939a-626bb638d3e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:13.976560 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-36097cc9-8e87-4307-939a-626bb638d3e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:13.976993 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-36097cc9-8e87-4307-939a-626bb638d3e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:13.993347 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-36097cc9-8e87-4307-939a-626bb638d3e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] HTTP exception thrown: Instance 0db1c6a9-bc5a-45f7-bbd3-590292385768 could not be found. Apr 11 16:46:13.993964 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-36097cc9-8e87-4307-939a-626bb638d3e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] Returning 404 to user: Instance 0db1c6a9-bc5a-45f7-bbd3-590292385768 could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:46:13.994776 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-36097cc9-8e87-4307-939a-626bb638d3e3 tempest-AttachVolumeTestJSON-1653638128 tempest-AttachVolumeTestJSON-1653638128-project] 10.222.0.65 "GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768" status: 404 len: 111 microversion: 2.1 time: 0.031353 Apr 11 16:46:13.995315 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 473/919] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:46:13 2022] GET /compute/v2.1/servers/0db1c6a9-bc5a-45f7-bbd3-590292385768 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:46:23.078138 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-36a664ee-c275-450c-aa53-9a20b381f697 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Action: 'create', calling method: .version_select at 0x7f7418130ca0>, body: {"keypair": {"name": "tempest-keypair-458417523"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:46:23.093240 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-36a664ee-c275-450c-aa53-9a20b381f697 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'key_pairs'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:46:23.097486 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-36a664ee-c275-450c-aa53-9a20b381f697 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for user 089723b908ba4a25bb83de445b69561d and project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'key_pairs'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:46:23.457523 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-36a664ee-c275-450c-aa53-9a20b381f697 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'key_pairs'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:46:23.463329 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-36a664ee-c275-450c-aa53-9a20b381f697 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for user 089723b908ba4a25bb83de445b69561d and project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'key_pairs'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:46:23.480399 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-36a664ee-c275-450c-aa53-9a20b381f697 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.574247 Apr 11 16:46:23.481313 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 447/920] 10.222.0.65 () {60 vars in 1157 bytes} [Mon Apr 11 16:46:22 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:46:24.960445 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-0c414854-d8fa-4f67-9c4f-a10c7578446c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2101915653", "imageRef": "e989c938-7b7a-445c-aec9-596e81d35104", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64f8adf0-5b62-426a-b30a-0690e612962b"}], "security_groups": [{"name": "tempest-securitygroup--1220037465"}], "key_name": "tempest-keypair-458417523", "user_data": "}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:46:25.087805 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.network.neutron [None req-0c414854-d8fa-4f67-9c4f-a10c7578446c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] validate_networks() for [('64f8adf0-5b62-426a-b30a-0690e612962b', None, None, None, None, None)] {{(pid=123773) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:46:25.806486 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-0c414854-d8fa-4f67-9c4f-a10c7578446c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Flavor limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:46:25.806906 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-0c414854-d8fa-4f67-9c4f-a10c7578446c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Image limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:46:25.807374 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-0c414854-d8fa-4f67-9c4f-a10c7578446c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Flavor pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:46:25.807827 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-0c414854-d8fa-4f67-9c4f-a10c7578446c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Image pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:46:25.808237 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-0c414854-d8fa-4f67-9c4f-a10c7578446c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:46:25.818058 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0c414854-d8fa-4f67-9c4f-a10c7578446c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:25.819233 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0c414854-d8fa-4f67-9c4f-a10c7578446c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:25.820088 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0c414854-d8fa-4f67-9c4f-a10c7578446c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:25.820516 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0c414854-d8fa-4f67-9c4f-a10c7578446c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:25.846081 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-0c414854-d8fa-4f67-9c4f-a10c7578446c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:46:25.850857 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-0c414854-d8fa-4f67-9c4f-a10c7578446c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for user 089723b908ba4a25bb83de445b69561d and project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:46:25.863719 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-0c414854-d8fa-4f67-9c4f-a10c7578446c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Going to run 1 instances... {{(pid=123773) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:46:25.866914 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-0c414854-d8fa-4f67-9c4f-a10c7578446c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e989c938-7b7a-445c-aec9-596e81d35104',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:46:25.918529 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-0c414854-d8fa-4f67-9c4f-a10c7578446c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.962632 Apr 11 16:46:25.932272 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-8e6b0376-940f-43fa-996e-04bfaa4c753e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:25.933088 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-8e6b0376-940f-43fa-996e-04bfaa4c753e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:25.936528 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 474/921] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Apr 11 16:46:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 16:46:26.019848 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8e6b0376-940f-43fa-996e-04bfaa4c753e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:26.036302 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-8e6b0376-940f-43fa-996e-04bfaa4c753e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247" status: 200 len: 1241 microversion: 2.1 time: 0.109670 Apr 11 16:46:26.055963 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 448/922] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:46:25 2022] GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247 => generated 1241 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:46:27.054865 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d7782a0a-85e3-4e81-a160-02dc3e7ca591 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:27.055486 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d7782a0a-85e3-4e81-a160-02dc3e7ca591 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:27.062287 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d7782a0a-85e3-4e81-a160-02dc3e7ca591 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:27.062728 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d7782a0a-85e3-4e81-a160-02dc3e7ca591 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:27.063546 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d7782a0a-85e3-4e81-a160-02dc3e7ca591 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:27.063964 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d7782a0a-85e3-4e81-a160-02dc3e7ca591 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:27.142782 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d7782a0a-85e3-4e81-a160-02dc3e7ca591 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:27.152043 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d7782a0a-85e3-4e81-a160-02dc3e7ca591 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247" status: 200 len: 1293 microversion: 2.1 time: 0.101631 Apr 11 16:46:27.159514 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 475/923] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:46:27 2022] GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247 => generated 1293 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:46:28.170628 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e9f7be82-62a2-4ff4-acce-3635d813966d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:28.171953 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e9f7be82-62a2-4ff4-acce-3635d813966d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:28.180381 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e9f7be82-62a2-4ff4-acce-3635d813966d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:28.181191 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e9f7be82-62a2-4ff4-acce-3635d813966d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:28.183085 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e9f7be82-62a2-4ff4-acce-3635d813966d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:28.183533 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e9f7be82-62a2-4ff4-acce-3635d813966d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:28.452588 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e9f7be82-62a2-4ff4-acce-3635d813966d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:28.460506 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e9f7be82-62a2-4ff4-acce-3635d813966d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247" status: 200 len: 1367 microversion: 2.1 time: 0.294723 Apr 11 16:46:28.461099 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 449/924] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:46:28 2022] GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:46:28.914016 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-66423c78-7985-45b3-989a-4024e9d9ce60 req-a5db7e7e-697f-47ec-b7b7-537761f93642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ba9b74-1ca3-4c03-b88e-c398753a5247", "tag": "57a7b058-1493-4381-8617-efe6e30e215c"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:46:28.927206 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-66423c78-7985-45b3-989a-4024e9d9ce60 req-a5db7e7e-697f-47ec-b7b7-537761f93642 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:28.927859 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-66423c78-7985-45b3-989a-4024e9d9ce60 req-a5db7e7e-697f-47ec-b7b7-537761f93642 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:28.939987 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-66423c78-7985-45b3-989a-4024e9d9ce60 req-a5db7e7e-697f-47ec-b7b7-537761f93642 service nova] Creating event network-changed:57a7b058-1493-4381-8617-efe6e30e215c for instance f8ba9b74-1ca3-4c03-b88e-c398753a5247 on hv-cinder-83716 Apr 11 16:46:28.945820 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-66423c78-7985-45b3-989a-4024e9d9ce60 req-a5db7e7e-697f-47ec-b7b7-537761f93642 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109194 Apr 11 16:46:28.946431 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 476/925] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:46:29.478243 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-734f336d-f0f7-4e40-a034-e8386f687e3b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:29.478814 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-734f336d-f0f7-4e40-a034-e8386f687e3b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:29.485538 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-734f336d-f0f7-4e40-a034-e8386f687e3b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:29.485983 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-734f336d-f0f7-4e40-a034-e8386f687e3b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:29.486757 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-734f336d-f0f7-4e40-a034-e8386f687e3b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:29.487184 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-734f336d-f0f7-4e40-a034-e8386f687e3b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:29.622347 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-734f336d-f0f7-4e40-a034-e8386f687e3b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:29.629868 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-734f336d-f0f7-4e40-a034-e8386f687e3b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247" status: 200 len: 1367 microversion: 2.1 time: 0.155611 Apr 11 16:46:29.630664 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 450/926] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:46:29 2022] GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:46:30.648396 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-cf14c0e1-e016-43fe-8975-57bb373f4223 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:30.649080 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-cf14c0e1-e016-43fe-8975-57bb373f4223 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:30.656214 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cf14c0e1-e016-43fe-8975-57bb373f4223 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:30.656628 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cf14c0e1-e016-43fe-8975-57bb373f4223 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:30.657430 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cf14c0e1-e016-43fe-8975-57bb373f4223 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:30.657854 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-cf14c0e1-e016-43fe-8975-57bb373f4223 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:30.798385 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-cf14c0e1-e016-43fe-8975-57bb373f4223 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:30.807408 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-cf14c0e1-e016-43fe-8975-57bb373f4223 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247" status: 200 len: 1367 microversion: 2.1 time: 0.163570 Apr 11 16:46:30.808053 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 477/927] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:46:30 2022] GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:46:31.825542 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-cc1b3203-0911-48b8-b6e4-a1275e256f84 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:31.826826 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-cc1b3203-0911-48b8-b6e4-a1275e256f84 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:31.833982 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-cc1b3203-0911-48b8-b6e4-a1275e256f84 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:31.834426 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-cc1b3203-0911-48b8-b6e4-a1275e256f84 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:31.835204 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-cc1b3203-0911-48b8-b6e4-a1275e256f84 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:31.835622 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-cc1b3203-0911-48b8-b6e4-a1275e256f84 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:32.031055 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-cc1b3203-0911-48b8-b6e4-a1275e256f84 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:32.040787 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-cc1b3203-0911-48b8-b6e4-a1275e256f84 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247" status: 200 len: 1367 microversion: 2.1 time: 0.218832 Apr 11 16:46:32.045492 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 451/928] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:46:31 2022] GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:46:33.063135 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-97788e14-f98c-4531-9507-f91c62c5aba1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:33.063779 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-97788e14-f98c-4531-9507-f91c62c5aba1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:33.071113 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-97788e14-f98c-4531-9507-f91c62c5aba1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:33.071555 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-97788e14-f98c-4531-9507-f91c62c5aba1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:33.072375 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-97788e14-f98c-4531-9507-f91c62c5aba1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:33.072805 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-97788e14-f98c-4531-9507-f91c62c5aba1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:33.237248 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-97788e14-f98c-4531-9507-f91c62c5aba1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:33.245891 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-97788e14-f98c-4531-9507-f91c62c5aba1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247" status: 200 len: 1367 microversion: 2.1 time: 0.186854 Apr 11 16:46:33.246492 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 478/929] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:46:33 2022] GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:46:34.196134 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-ffd212c2-91ca-4a27-b0fe-ca2622acd285 req-55394ebf-b636-4d0e-be08-ffea1bb155d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ba9b74-1ca3-4c03-b88e-c398753a5247", "name": "network-vif-plugged", "status": "completed", "tag": "57a7b058-1493-4381-8617-efe6e30e215c"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:46:34.206608 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-ffd212c2-91ca-4a27-b0fe-ca2622acd285 req-55394ebf-b636-4d0e-be08-ffea1bb155d0 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:34.207048 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-ffd212c2-91ca-4a27-b0fe-ca2622acd285 req-55394ebf-b636-4d0e-be08-ffea1bb155d0 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:34.218873 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-ffd212c2-91ca-4a27-b0fe-ca2622acd285 req-55394ebf-b636-4d0e-be08-ffea1bb155d0 service nova] Creating event network-vif-plugged:57a7b058-1493-4381-8617-efe6e30e215c for instance f8ba9b74-1ca3-4c03-b88e-c398753a5247 on hv-cinder-83716 Apr 11 16:46:34.224225 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-ffd212c2-91ca-4a27-b0fe-ca2622acd285 req-55394ebf-b636-4d0e-be08-ffea1bb155d0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032847 Apr 11 16:46:34.224849 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 452/930] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:46:34.263085 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f04c5520-f57e-435b-a3f2-f1e5ff64bff8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:34.263785 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f04c5520-f57e-435b-a3f2-f1e5ff64bff8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:34.271105 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f04c5520-f57e-435b-a3f2-f1e5ff64bff8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:34.271551 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f04c5520-f57e-435b-a3f2-f1e5ff64bff8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:34.272392 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f04c5520-f57e-435b-a3f2-f1e5ff64bff8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:34.272832 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f04c5520-f57e-435b-a3f2-f1e5ff64bff8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:34.476157 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f04c5520-f57e-435b-a3f2-f1e5ff64bff8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:34.484236 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f04c5520-f57e-435b-a3f2-f1e5ff64bff8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247" status: 200 len: 1367 microversion: 2.1 time: 0.225154 Apr 11 16:46:34.484937 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 479/931] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:46:34 2022] GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:46:35.507185 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-69f5ae18-f73d-48eb-903e-9e060c8349e5 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:35.507865 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-69f5ae18-f73d-48eb-903e-9e060c8349e5 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:35.514570 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-69f5ae18-f73d-48eb-903e-9e060c8349e5 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:35.515010 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-69f5ae18-f73d-48eb-903e-9e060c8349e5 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:35.515864 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-69f5ae18-f73d-48eb-903e-9e060c8349e5 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:35.516290 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-69f5ae18-f73d-48eb-903e-9e060c8349e5 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:35.653133 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-69f5ae18-f73d-48eb-903e-9e060c8349e5 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:35.661284 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-69f5ae18-f73d-48eb-903e-9e060c8349e5 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247" status: 200 len: 1367 microversion: 2.1 time: 0.159024 Apr 11 16:46:35.661869 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 453/932] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:46:35 2022] GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:46:36.679305 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ecf93368-1fce-41f2-97ed-bb5c632ba050 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:36.680128 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ecf93368-1fce-41f2-97ed-bb5c632ba050 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:36.687125 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ecf93368-1fce-41f2-97ed-bb5c632ba050 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:36.687561 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ecf93368-1fce-41f2-97ed-bb5c632ba050 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:36.688352 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ecf93368-1fce-41f2-97ed-bb5c632ba050 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:36.688775 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ecf93368-1fce-41f2-97ed-bb5c632ba050 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:36.826865 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ecf93368-1fce-41f2-97ed-bb5c632ba050 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:36.835371 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ecf93368-1fce-41f2-97ed-bb5c632ba050 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247" status: 200 len: 1557 microversion: 2.1 time: 0.160582 Apr 11 16:46:36.836006 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 480/933] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:46:36 2022] GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:46:36.852124 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-31fae8e4-9062-4d39-9d18-bc2c7acc5d48 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:36.852770 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-31fae8e4-9062-4d39-9d18-bc2c7acc5d48 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:36.859166 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-31fae8e4-9062-4d39-9d18-bc2c7acc5d48 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:36.859604 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-31fae8e4-9062-4d39-9d18-bc2c7acc5d48 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:36.860384 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-31fae8e4-9062-4d39-9d18-bc2c7acc5d48 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:36.860812 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-31fae8e4-9062-4d39-9d18-bc2c7acc5d48 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:36.943612 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-31fae8e4-9062-4d39-9d18-bc2c7acc5d48 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095587 Apr 11 16:46:36.944254 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 454/934] 10.222.0.65 () {58 vars in 1274 bytes} [Mon Apr 11 16:46:36 2022] GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:46:37.991934 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-200f692a-9c3b-4690-bc74-af8a748f74a9 req-f58aef5d-8d68-4a23-8c95-560ec193007a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ba9b74-1ca3-4c03-b88e-c398753a5247", "tag": "57a7b058-1493-4381-8617-efe6e30e215c"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:46:38.000487 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-200f692a-9c3b-4690-bc74-af8a748f74a9 req-f58aef5d-8d68-4a23-8c95-560ec193007a service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:38.000923 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-200f692a-9c3b-4690-bc74-af8a748f74a9 req-f58aef5d-8d68-4a23-8c95-560ec193007a service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:38.013713 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-200f692a-9c3b-4690-bc74-af8a748f74a9 req-f58aef5d-8d68-4a23-8c95-560ec193007a service nova] Creating event network-changed:57a7b058-1493-4381-8617-efe6e30e215c for instance f8ba9b74-1ca3-4c03-b88e-c398753a5247 on hv-cinder-83716 Apr 11 16:46:38.020136 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-200f692a-9c3b-4690-bc74-af8a748f74a9 req-f58aef5d-8d68-4a23-8c95-560ec193007a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032014 Apr 11 16:46:38.020967 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 481/935] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:46:53.926458 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-97dac931-b0ad-4aa8-9d8a-ce2d0e91b3ab tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:53.927400 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-97dac931-b0ad-4aa8-9d8a-ce2d0e91b3ab tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:53.934252 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-97dac931-b0ad-4aa8-9d8a-ce2d0e91b3ab tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:53.934703 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-97dac931-b0ad-4aa8-9d8a-ce2d0e91b3ab tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:53.935596 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-97dac931-b0ad-4aa8-9d8a-ce2d0e91b3ab tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:53.936136 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-97dac931-b0ad-4aa8-9d8a-ce2d0e91b3ab tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:53.970048 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-97dac931-b0ad-4aa8-9d8a-ce2d0e91b3ab tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048258 Apr 11 16:46:53.970653 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 455/936] 10.222.0.65 () {60 vars in 1342 bytes} [Mon Apr 11 16:46:53 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:46:54.034056 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1442f963-4c91-4327-9c2a-019375c0dc79 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:54.034056 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1442f963-4c91-4327-9c2a-019375c0dc79 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:54.045057 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1442f963-4c91-4327-9c2a-019375c0dc79 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:54.045500 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1442f963-4c91-4327-9c2a-019375c0dc79 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:54.046317 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1442f963-4c91-4327-9c2a-019375c0dc79 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:54.046754 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1442f963-4c91-4327-9c2a-019375c0dc79 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:54.072696 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1442f963-4c91-4327-9c2a-019375c0dc79 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Going to try to terminate instance {{(pid=123773) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:46:54.162071 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1442f963-4c91-4327-9c2a-019375c0dc79 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "DELETE /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 204 len: 0 microversion: 2.20 time: 0.133088 Apr 11 16:46:54.162630 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 482/937] 10.222.0.65 () {60 vars in 1279 bytes} [Mon Apr 11 16:46:54 2022] DELETE /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 16:46:54.171376 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-dc05804a-0e33-4290-87e9-4007246ff392 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:54.172019 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-dc05804a-0e33-4290-87e9-4007246ff392 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:54.178750 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dc05804a-0e33-4290-87e9-4007246ff392 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:54.179189 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dc05804a-0e33-4290-87e9-4007246ff392 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:54.180035 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dc05804a-0e33-4290-87e9-4007246ff392 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:54.180463 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dc05804a-0e33-4290-87e9-4007246ff392 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:54.319660 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-dc05804a-0e33-4290-87e9-4007246ff392 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:54.328073 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-dc05804a-0e33-4290-87e9-4007246ff392 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:54.329562 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-dc05804a-0e33-4290-87e9-4007246ff392 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:54.330763 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-dc05804a-0e33-4290-87e9-4007246ff392 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1723 microversion: 2.20 time: 0.163633 Apr 11 16:46:54.331728 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 456/938] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:46:54 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:46:55.350539 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f3dc341e-355c-4b08-a3bf-210b93a488dd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:55.351160 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f3dc341e-355c-4b08-a3bf-210b93a488dd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:55.357966 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f3dc341e-355c-4b08-a3bf-210b93a488dd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:55.358404 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f3dc341e-355c-4b08-a3bf-210b93a488dd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:55.359179 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f3dc341e-355c-4b08-a3bf-210b93a488dd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:55.359607 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f3dc341e-355c-4b08-a3bf-210b93a488dd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:55.504180 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f3dc341e-355c-4b08-a3bf-210b93a488dd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:55.512389 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f3dc341e-355c-4b08-a3bf-210b93a488dd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:55.513869 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f3dc341e-355c-4b08-a3bf-210b93a488dd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:55.515026 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f3dc341e-355c-4b08-a3bf-210b93a488dd tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1723 microversion: 2.20 time: 0.169584 Apr 11 16:46:55.515585 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 483/939] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:46:55 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:46:56.532697 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-bccf1c18-02ba-4920-9878-681e70935024 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:56.533335 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-bccf1c18-02ba-4920-9878-681e70935024 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:56.540793 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bccf1c18-02ba-4920-9878-681e70935024 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:56.541576 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bccf1c18-02ba-4920-9878-681e70935024 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:56.542372 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bccf1c18-02ba-4920-9878-681e70935024 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:56.542792 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bccf1c18-02ba-4920-9878-681e70935024 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:56.636500 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-bccf1c18-02ba-4920-9878-681e70935024 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:56.645588 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-bccf1c18-02ba-4920-9878-681e70935024 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:56.647095 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-bccf1c18-02ba-4920-9878-681e70935024 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '98902ced574b44779b9aec59a2f999fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fff5d5c8db254085a82ca911ead15f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:46:56.648348 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-bccf1c18-02ba-4920-9878-681e70935024 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 200 len: 1655 microversion: 2.20 time: 0.119646 Apr 11 16:46:56.649323 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 457/940] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:46:56 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 1655 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:46:56.846172 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-27a9c72b-fa0d-4cf7-bc10-c8163b2aa04f req-af66225f-8447-4a0e-b32c-3c71fe6a8ecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29dde975-c7d2-4621-9914-28ebf83c7285", "name": "network-vif-deleted", "tag": "49b5ba7a-7f54-4acc-8206-d942c4884181"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:46:56.858296 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-27a9c72b-fa0d-4cf7-bc10-c8163b2aa04f req-af66225f-8447-4a0e-b32c-3c71fe6a8ecc service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:56.858750 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-27a9c72b-fa0d-4cf7-bc10-c8163b2aa04f req-af66225f-8447-4a0e-b32c-3c71fe6a8ecc service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:56.891837 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-27a9c72b-fa0d-4cf7-bc10-c8163b2aa04f req-af66225f-8447-4a0e-b32c-3c71fe6a8ecc service nova] Creating event network-vif-deleted:49b5ba7a-7f54-4acc-8206-d942c4884181 for instance 29dde975-c7d2-4621-9914-28ebf83c7285 on hv-cinder-83716 Apr 11 16:46:56.897933 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-27a9c72b-fa0d-4cf7-bc10-c8163b2aa04f req-af66225f-8447-4a0e-b32c-3c71fe6a8ecc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055469 Apr 11 16:46:56.899104 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 484/941] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:46:57.666838 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-1fb4c73f-5598-4eae-89ee-b28f82997c39 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:57.667437 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-1fb4c73f-5598-4eae-89ee-b28f82997c39 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:57.675576 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1fb4c73f-5598-4eae-89ee-b28f82997c39 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:57.677389 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1fb4c73f-5598-4eae-89ee-b28f82997c39 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:57.678830 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1fb4c73f-5598-4eae-89ee-b28f82997c39 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:57.679333 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1fb4c73f-5598-4eae-89ee-b28f82997c39 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:57.697347 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-1fb4c73f-5598-4eae-89ee-b28f82997c39 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] HTTP exception thrown: Instance 29dde975-c7d2-4621-9914-28ebf83c7285 could not be found. Apr 11 16:46:57.697947 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-1fb4c73f-5598-4eae-89ee-b28f82997c39 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Returning 404 to user: Instance 29dde975-c7d2-4621-9914-28ebf83c7285 could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:46:57.698789 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-1fb4c73f-5598-4eae-89ee-b28f82997c39 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 404 len: 111 microversion: 2.20 time: 0.036095 Apr 11 16:46:57.699379 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 458/942] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:46:57 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 16:46:57.709829 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ea81feca-91c4-4ea6-82a1-7e157f13901e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '.version_select at 0x7f741c0f9790>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:57.737975 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ea81feca-91c4-4ea6-82a1-7e157f13901e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1143621005" status: 204 len: 0 microversion: 2.20 time: 0.033000 Apr 11 16:46:57.738551 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 485/943] 10.222.0.65 () {60 vars in 1261 bytes} [Mon Apr 11 16:46:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1143621005 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 16:46:59.547946 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-48a7196e-34cf-4f92-a315-d09553af499e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:59.548605 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-48a7196e-34cf-4f92-a315-d09553af499e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:59.556367 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-48a7196e-34cf-4f92-a315-d09553af499e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:59.556823 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-48a7196e-34cf-4f92-a315-d09553af499e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:59.557650 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-48a7196e-34cf-4f92-a315-d09553af499e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:59.558089 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-48a7196e-34cf-4f92-a315-d09553af499e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:59.579339 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-48a7196e-34cf-4f92-a315-d09553af499e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] HTTP exception thrown: Instance 29dde975-c7d2-4621-9914-28ebf83c7285 could not be found. Apr 11 16:46:59.580125 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-48a7196e-34cf-4f92-a315-d09553af499e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Returning 404 to user: Instance 29dde975-c7d2-4621-9914-28ebf83c7285 could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:46:59.581538 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-48a7196e-34cf-4f92-a315-d09553af499e tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "DELETE /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 404 len: 111 microversion: 2.20 time: 0.037751 Apr 11 16:46:59.583147 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 459/944] 10.222.0.65 () {60 vars in 1279 bytes} [Mon Apr 11 16:46:59 2022] DELETE /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 16:46:59.591693 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-02594c42-7d65-4462-86fa-d1cea177aa02 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:46:59.592450 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-02594c42-7d65-4462-86fa-d1cea177aa02 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: 29dde975-c7d2-4621-9914-28ebf83c7285] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:46:59.599879 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-02594c42-7d65-4462-86fa-d1cea177aa02 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:59.600327 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-02594c42-7d65-4462-86fa-d1cea177aa02 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:59.601122 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-02594c42-7d65-4462-86fa-d1cea177aa02 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:46:59.601548 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-02594c42-7d65-4462-86fa-d1cea177aa02 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:46:59.617194 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-02594c42-7d65-4462-86fa-d1cea177aa02 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] HTTP exception thrown: Instance 29dde975-c7d2-4621-9914-28ebf83c7285 could not be found. Apr 11 16:46:59.617796 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-02594c42-7d65-4462-86fa-d1cea177aa02 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Returning 404 to user: Instance 29dde975-c7d2-4621-9914-28ebf83c7285 could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:46:59.618667 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-02594c42-7d65-4462-86fa-d1cea177aa02 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285" status: 404 len: 111 microversion: 2.20 time: 0.031613 Apr 11 16:46:59.619253 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 486/945] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:46:59 2022] GET /compute/v2.1/servers/29dde975-c7d2-4621-9914-28ebf83c7285 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 16:47:00.773371 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-1732e235-bc70-47de-bc15-1da4717c3468 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:00.773943 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-1732e235-bc70-47de-bc15-1da4717c3468 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:00.780686 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1732e235-bc70-47de-bc15-1da4717c3468 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:00.781123 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1732e235-bc70-47de-bc15-1da4717c3468 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:00.781905 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1732e235-bc70-47de-bc15-1da4717c3468 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:00.782336 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1732e235-bc70-47de-bc15-1da4717c3468 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:00.797168 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-1732e235-bc70-47de-bc15-1da4717c3468 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] HTTP exception thrown: Instance f08685e5-3c41-4032-9633-cc591711221a could not be found. Apr 11 16:47:00.797789 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-1732e235-bc70-47de-bc15-1da4717c3468 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Returning 404 to user: Instance f08685e5-3c41-4032-9633-cc591711221a could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:47:00.798655 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-1732e235-bc70-47de-bc15-1da4717c3468 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 404 len: 111 microversion: 2.20 time: 0.030213 Apr 11 16:47:00.799225 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 460/946] 10.222.0.65 () {60 vars in 1279 bytes} [Mon Apr 11 16:47:00 2022] DELETE /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 16:47:00.808056 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-37921ab1-f352-4d71-b073-7ac4359dd8a6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:00.808714 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-37921ab1-f352-4d71-b073-7ac4359dd8a6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] [instance: f08685e5-3c41-4032-9633-cc591711221a] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:00.815232 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-37921ab1-f352-4d71-b073-7ac4359dd8a6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:00.816584 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-37921ab1-f352-4d71-b073-7ac4359dd8a6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:00.817384 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-37921ab1-f352-4d71-b073-7ac4359dd8a6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:00.817819 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-37921ab1-f352-4d71-b073-7ac4359dd8a6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:00.839245 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-37921ab1-f352-4d71-b073-7ac4359dd8a6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] HTTP exception thrown: Instance f08685e5-3c41-4032-9633-cc591711221a could not be found. Apr 11 16:47:00.840311 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-37921ab1-f352-4d71-b073-7ac4359dd8a6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] Returning 404 to user: Instance f08685e5-3c41-4032-9633-cc591711221a could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:47:00.841853 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-37921ab1-f352-4d71-b073-7ac4359dd8a6 tempest-AttachVolumeShelveTestJSON-677128371 tempest-AttachVolumeShelveTestJSON-677128371-project] 10.222.0.65 "GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a" status: 404 len: 111 microversion: 2.20 time: 0.037480 Apr 11 16:47:00.843139 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 487/947] 10.222.0.65 () {60 vars in 1276 bytes} [Mon Apr 11 16:47:00 2022] GET /compute/v2.1/servers/f08685e5-3c41-4032-9633-cc591711221a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 16:47:02.673584 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:47:02.674221 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: Mon Apr 11 16:47:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 16:47:05.907789 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-294f150b-1fbe-4217-8c06-9d03fd7102a4 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Action: 'create', calling method: .version_select at 0x7f7418151f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1361299876"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:47:06.219161 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-294f150b-1fbe-4217-8c06-9d03fd7102a4 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.441767 Apr 11 16:47:06.220372 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 461/948] 10.222.0.65 () {60 vars in 1154 bytes} [Mon Apr 11 16:47:05 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 444 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 11 16:47:06.234774 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-5f7fa3b1-ddee-448c-8187-cba91675e087 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Calling method '.version_select at 0x7f741c136790>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:06.305603 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-5f7fa3b1-ddee-448c-8187-cba91675e087 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/eb28bdde-f4db-48db-b935-acb031379227" status: 200 len: 345 microversion: 2.1 time: 0.074720 Apr 11 16:47:06.306211 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 488/949] 10.222.0.65 () {58 vars in 1244 bytes} [Mon Apr 11 16:47:06 2022] GET /compute/v2.1/os-volumes/eb28bdde-f4db-48db-b935-acb031379227 => generated 345 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:47:07.319326 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-bf0d5100-0b2f-4406-9ec6-03bb9a4f83f8 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Calling method '.version_select at 0x7f7412fa7160>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:07.373933 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-bf0d5100-0b2f-4406-9ec6-03bb9a4f83f8 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/eb28bdde-f4db-48db-b935-acb031379227" status: 200 len: 346 microversion: 2.1 time: 0.059152 Apr 11 16:47:07.374505 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 462/950] 10.222.0.65 () {58 vars in 1244 bytes} [Mon Apr 11 16:47:07 2022] GET /compute/v2.1/os-volumes/eb28bdde-f4db-48db-b935-acb031379227 => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:47:07.386509 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-12ff24a9-b9a6-4e5e-965a-e1ea903738fa tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Action: 'create', calling method: .version_select at 0x7f7418116f70>, body: {"snapshot": {"volume_id": "eb28bdde-f4db-48db-b935-acb031379227", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1960337956"}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:47:07.548796 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-12ff24a9-b9a6-4e5e-965a-e1ea903738fa tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] 10.222.0.65 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.166706 Apr 11 16:47:07.551814 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 489/951] 10.222.0.65 () {60 vars in 1161 bytes} [Mon Apr 11 16:47:07 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:47:07.565495 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-b97121df-2311-4f08-bf80-713e140463bc tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Calling method '.version_select at 0x7f741813cd30>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:07.601151 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-b97121df-2311-4f08-bf80-713e140463bc tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/96ea999f-3c95-410d-b49c-e49d0e41ae50" status: 200 len: 287 microversion: 2.1 time: 0.042829 Apr 11 16:47:07.601726 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 463/952] 10.222.0.65 () {58 vars in 1250 bytes} [Mon Apr 11 16:47:07 2022] GET /compute/v2.1/os-snapshots/96ea999f-3c95-410d-b49c-e49d0e41ae50 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:47:07.611650 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-0f528274-c5ce-4c5f-b61d-337cbf422cf9 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Calling method '.version_select at 0x7f741820cb80>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:07.643024 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-0f528274-c5ce-4c5f-b61d-337cbf422cf9 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035130 Apr 11 16:47:07.643796 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 490/953] 10.222.0.65 () {58 vars in 1139 bytes} [Mon Apr 11 16:47:07 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:47:07.656063 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c62234ed-f84a-414b-8eec-4625c88f41c4 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Calling method '.version_select at 0x7f7418151700>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:07.690193 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c62234ed-f84a-414b-8eec-4625c88f41c4 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/96ea999f-3c95-410d-b49c-e49d0e41ae50" status: 200 len: 287 microversion: 2.1 time: 0.038047 Apr 11 16:47:07.690779 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 464/954] 10.222.0.65 () {58 vars in 1250 bytes} [Mon Apr 11 16:47:07 2022] GET /compute/v2.1/os-snapshots/96ea999f-3c95-410d-b49c-e49d0e41ae50 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:47:08.704403 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-457f6474-60b9-492a-82b7-60db520d6b7a tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Calling method '.version_select at 0x7f7418207790>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:08.734637 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-457f6474-60b9-492a-82b7-60db520d6b7a tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/96ea999f-3c95-410d-b49c-e49d0e41ae50" status: 200 len: 287 microversion: 2.1 time: 0.034667 Apr 11 16:47:08.735205 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 491/955] 10.222.0.65 () {58 vars in 1250 bytes} [Mon Apr 11 16:47:08 2022] GET /compute/v2.1/os-snapshots/96ea999f-3c95-410d-b49c-e49d0e41ae50 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:47:09.748176 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-0c9f26c8-9e9d-414f-961a-984c8dea0ae6 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Calling method '.version_select at 0x7f7418175d30>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:09.783556 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-0c9f26c8-9e9d-414f-961a-984c8dea0ae6 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/96ea999f-3c95-410d-b49c-e49d0e41ae50" status: 200 len: 287 microversion: 2.1 time: 0.040163 Apr 11 16:47:09.784206 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 465/956] 10.222.0.65 () {58 vars in 1250 bytes} [Mon Apr 11 16:47:09 2022] GET /compute/v2.1/os-snapshots/96ea999f-3c95-410d-b49c-e49d0e41ae50 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:47:09.862165 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-9a40044d-c0c5-4025-921a-89ddccfa0f65 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:09.863049 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-9a40044d-c0c5-4025-921a-89ddccfa0f65 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:09.870362 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9a40044d-c0c5-4025-921a-89ddccfa0f65 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:09.870753 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9a40044d-c0c5-4025-921a-89ddccfa0f65 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:09.871538 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9a40044d-c0c5-4025-921a-89ddccfa0f65 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:09.872006 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9a40044d-c0c5-4025-921a-89ddccfa0f65 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:09.898929 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-9a40044d-c0c5-4025-921a-89ddccfa0f65 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Going to try to terminate instance {{(pid=123773) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:47:09.980283 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-9a40044d-c0c5-4025-921a-89ddccfa0f65 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "DELETE /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 204 len: 0 microversion: 2.1 time: 0.122364 Apr 11 16:47:09.981014 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 492/957] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:47:09 2022] DELETE /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:47:09.990120 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-308689c1-2735-4177-a46e-063142d495c8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:09.990817 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-308689c1-2735-4177-a46e-063142d495c8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:09.997518 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-308689c1-2735-4177-a46e-063142d495c8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:09.997960 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-308689c1-2735-4177-a46e-063142d495c8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:09.998785 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-308689c1-2735-4177-a46e-063142d495c8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:09.999150 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-308689c1-2735-4177-a46e-063142d495c8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:10.155313 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-308689c1-2735-4177-a46e-063142d495c8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:10.165906 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-308689c1-2735-4177-a46e-063142d495c8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1579 microversion: 2.1 time: 0.179967 Apr 11 16:47:10.166709 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 466/958] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:09 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1579 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:47:10.795544 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-80049428-c106-41dc-947d-391f4ec69b4c tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Calling method '.version_select at 0x7f741820ca60>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:10.827792 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-80049428-c106-41dc-947d-391f4ec69b4c tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/96ea999f-3c95-410d-b49c-e49d0e41ae50" status: 200 len: 287 microversion: 2.1 time: 0.036490 Apr 11 16:47:10.828354 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 493/959] 10.222.0.65 () {58 vars in 1250 bytes} [Mon Apr 11 16:47:10 2022] GET /compute/v2.1/os-snapshots/96ea999f-3c95-410d-b49c-e49d0e41ae50 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:47:11.184319 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-7c75bca3-dc8f-4602-9ce9-2d0c0a6b8640 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:11.184969 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-7c75bca3-dc8f-4602-9ce9-2d0c0a6b8640 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:11.192936 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7c75bca3-dc8f-4602-9ce9-2d0c0a6b8640 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:11.193388 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7c75bca3-dc8f-4602-9ce9-2d0c0a6b8640 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:11.194183 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7c75bca3-dc8f-4602-9ce9-2d0c0a6b8640 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:11.194617 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7c75bca3-dc8f-4602-9ce9-2d0c0a6b8640 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:11.340152 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-7c75bca3-dc8f-4602-9ce9-2d0c0a6b8640 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:11.348884 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-7c75bca3-dc8f-4602-9ce9-2d0c0a6b8640 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1579 microversion: 2.1 time: 0.168585 Apr 11 16:47:11.349483 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 467/960] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:11 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1579 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:47:11.840912 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ef619502-b8b5-4777-a28c-7269c79630b7 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Calling method '.version_select at 0x7f741c0f93a0>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:11.871181 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ef619502-b8b5-4777-a28c-7269c79630b7 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/96ea999f-3c95-410d-b49c-e49d0e41ae50" status: 200 len: 287 microversion: 2.1 time: 0.034666 Apr 11 16:47:11.871775 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 494/961] 10.222.0.65 () {58 vars in 1250 bytes} [Mon Apr 11 16:47:11 2022] GET /compute/v2.1/os-snapshots/96ea999f-3c95-410d-b49c-e49d0e41ae50 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:47:12.367401 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ec8d6f3f-409c-4ac1-883e-ece00ed1cbb7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:12.368142 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ec8d6f3f-409c-4ac1-883e-ece00ed1cbb7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:12.374759 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ec8d6f3f-409c-4ac1-883e-ece00ed1cbb7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:12.375203 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ec8d6f3f-409c-4ac1-883e-ece00ed1cbb7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:12.376013 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ec8d6f3f-409c-4ac1-883e-ece00ed1cbb7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:12.376442 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ec8d6f3f-409c-4ac1-883e-ece00ed1cbb7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:12.517855 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ec8d6f3f-409c-4ac1-883e-ece00ed1cbb7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:12.526151 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ec8d6f3f-409c-4ac1-883e-ece00ed1cbb7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1579 microversion: 2.1 time: 0.163045 Apr 11 16:47:12.526735 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 468/962] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:12 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1579 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:47:12.884499 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-86ef917b-7bd4-4f1b-9729-746eefc4af58 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Calling method '.version_select at 0x7f741820c700>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:12.916040 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-86ef917b-7bd4-4f1b-9729-746eefc4af58 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/96ea999f-3c95-410d-b49c-e49d0e41ae50" status: 200 len: 288 microversion: 2.1 time: 0.036124 Apr 11 16:47:12.916622 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 495/963] 10.222.0.65 () {58 vars in 1250 bytes} [Mon Apr 11 16:47:12 2022] GET /compute/v2.1/os-snapshots/96ea999f-3c95-410d-b49c-e49d0e41ae50 => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:47:12.927527 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d7e1cc23-358d-4d01-b8da-eb4016a68ffe tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Calling method '.version_select at 0x7f74181de550>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:12.988617 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d7e1cc23-358d-4d01-b8da-eb4016a68ffe tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] 10.222.0.65 "DELETE /compute/v2.1/os-snapshots/96ea999f-3c95-410d-b49c-e49d0e41ae50" status: 202 len: 0 microversion: 2.1 time: 0.065045 Apr 11 16:47:12.989213 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 469/964] 10.222.0.65 () {58 vars in 1253 bytes} [Mon Apr 11 16:47:12 2022] DELETE /compute/v2.1/os-snapshots/96ea999f-3c95-410d-b49c-e49d0e41ae50 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:47:13.000063 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c56d0fe6-859b-4c2f-b16b-b54c9355ffa8 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Calling method '.version_select at 0x7f74181bf1f0>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:13.045310 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c56d0fe6-859b-4c2f-b16b-b54c9355ffa8 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/96ea999f-3c95-410d-b49c-e49d0e41ae50" status: 200 len: 287 microversion: 2.1 time: 0.050334 Apr 11 16:47:13.045994 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 496/965] 10.222.0.65 () {58 vars in 1250 bytes} [Mon Apr 11 16:47:12 2022] GET /compute/v2.1/os-snapshots/96ea999f-3c95-410d-b49c-e49d0e41ae50 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:47:13.543616 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e7df7336-f905-47fe-90e7-d24c304faf4f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:13.544604 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e7df7336-f905-47fe-90e7-d24c304faf4f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:13.552474 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e7df7336-f905-47fe-90e7-d24c304faf4f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:13.552924 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e7df7336-f905-47fe-90e7-d24c304faf4f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:13.553932 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e7df7336-f905-47fe-90e7-d24c304faf4f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:13.554702 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e7df7336-f905-47fe-90e7-d24c304faf4f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:13.808461 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e7df7336-f905-47fe-90e7-d24c304faf4f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:13.816812 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e7df7336-f905-47fe-90e7-d24c304faf4f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1579 microversion: 2.1 time: 0.277822 Apr 11 16:47:13.817406 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 470/966] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:13 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1579 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:47:14.066710 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-0c7682b5-4fe5-4a98-8987-c5349d6b675b tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Calling method '.version_select at 0x7f7418116ee0>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:14.103778 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-0c7682b5-4fe5-4a98-8987-c5349d6b675b tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] HTTP exception thrown: Snapshot 96ea999f-3c95-410d-b49c-e49d0e41ae50 could not be found. Apr 11 16:47:14.104620 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-0c7682b5-4fe5-4a98-8987-c5349d6b675b tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Returning 404 to user: Snapshot 96ea999f-3c95-410d-b49c-e49d0e41ae50 could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:47:14.105674 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-0c7682b5-4fe5-4a98-8987-c5349d6b675b tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/96ea999f-3c95-410d-b49c-e49d0e41ae50" status: 404 len: 111 microversion: 2.1 time: 0.051590 Apr 11 16:47:14.107585 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 497/967] 10.222.0.65 () {58 vars in 1250 bytes} [Mon Apr 11 16:47:14 2022] GET /compute/v2.1/os-snapshots/96ea999f-3c95-410d-b49c-e49d0e41ae50 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:47:14.119728 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-dce82232-d7f1-45e9-bdb6-f8317d021667 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Calling method '.version_select at 0x7f741820cc10>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:14.122518 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-aad0b154-abb1-4659-9d37-8279d140a694 req-7b44ce0c-8c60-4ac1-b648-dcca5ec5b548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb39f773-fda3-4634-8e69-055b9315e3ba", "name": "network-vif-deleted", "tag": "67220eb2-d14a-4887-a614-ae13ad4fa4be"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:47:14.148461 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-aad0b154-abb1-4659-9d37-8279d140a694 req-7b44ce0c-8c60-4ac1-b648-dcca5ec5b548 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:14.157338 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-aad0b154-abb1-4659-9d37-8279d140a694 req-7b44ce0c-8c60-4ac1-b648-dcca5ec5b548 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:14.186266 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-aad0b154-abb1-4659-9d37-8279d140a694 req-7b44ce0c-8c60-4ac1-b648-dcca5ec5b548 service nova] Creating event network-vif-deleted:67220eb2-d14a-4887-a614-ae13ad4fa4be for instance bb39f773-fda3-4634-8e69-055b9315e3ba on hv-cinder-83716 Apr 11 16:47:14.193786 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-aad0b154-abb1-4659-9d37-8279d140a694 req-7b44ce0c-8c60-4ac1-b648-dcca5ec5b548 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116508 Apr 11 16:47:14.195095 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 471/968] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:47:14.234084 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-dce82232-d7f1-45e9-bdb6-f8317d021667 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/eb28bdde-f4db-48db-b935-acb031379227" status: 202 len: 0 microversion: 2.1 time: 0.118788 Apr 11 16:47:14.237821 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 498/969] 10.222.0.65 () {58 vars in 1247 bytes} [Mon Apr 11 16:47:14 2022] DELETE /compute/v2.1/os-volumes/eb28bdde-f4db-48db-b935-acb031379227 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:47:14.248367 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-307585d1-d663-474b-bb19-63911d932dd8 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Calling method '.version_select at 0x7f74181a8dc0>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:14.308585 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-307585d1-d663-474b-bb19-63911d932dd8 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/eb28bdde-f4db-48db-b935-acb031379227" status: 200 len: 345 microversion: 2.1 time: 0.066154 Apr 11 16:47:14.312491 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 472/970] 10.222.0.65 () {58 vars in 1244 bytes} [Mon Apr 11 16:47:14 2022] GET /compute/v2.1/os-volumes/eb28bdde-f4db-48db-b935-acb031379227 => generated 345 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:47:14.834736 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3ccba857-0bcb-46b7-a008-778b02fc7418 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:14.835528 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3ccba857-0bcb-46b7-a008-778b02fc7418 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:14.842371 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3ccba857-0bcb-46b7-a008-778b02fc7418 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:14.842817 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3ccba857-0bcb-46b7-a008-778b02fc7418 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:14.843600 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3ccba857-0bcb-46b7-a008-778b02fc7418 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:14.844272 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3ccba857-0bcb-46b7-a008-778b02fc7418 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:14.879876 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3ccba857-0bcb-46b7-a008-778b02fc7418 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:14.880329 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3ccba857-0bcb-46b7-a008-778b02fc7418 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:14.880785 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.objects.instance [None req-3ccba857-0bcb-46b7-a008-778b02fc7418 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lazy-loading 'fault' on Instance uuid bb39f773-fda3-4634-8e69-055b9315e3ba {{(pid=123773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:47:14.927900 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-3ccba857-0bcb-46b7-a008-778b02fc7418 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:14.936601 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3ccba857-0bcb-46b7-a008-778b02fc7418 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 200 len: 1185 microversion: 2.1 time: 0.105762 Apr 11 16:47:14.937373 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 499/971] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:14 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 1185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:47:15.322801 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-68741c6d-7cca-4776-8b9a-dc49492099a2 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Calling method '.version_select at 0x7f74181de430>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:15.352632 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-68741c6d-7cca-4776-8b9a-dc49492099a2 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] HTTP exception thrown: Volume eb28bdde-f4db-48db-b935-acb031379227 could not be found. Apr 11 16:47:15.353228 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-68741c6d-7cca-4776-8b9a-dc49492099a2 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Returning 404 to user: Volume eb28bdde-f4db-48db-b935-acb031379227 could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:47:15.354066 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-68741c6d-7cca-4776-8b9a-dc49492099a2 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/eb28bdde-f4db-48db-b935-acb031379227" status: 404 len: 109 microversion: 2.1 time: 0.035767 Apr 11 16:47:15.354633 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 473/972] 10.222.0.65 () {58 vars in 1244 bytes} [Mon Apr 11 16:47:15 2022] GET /compute/v2.1/os-volumes/eb28bdde-f4db-48db-b935-acb031379227 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:47:15.367469 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-8115ecea-2e12-4f20-8292-ffd0f1ab28f6 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Calling method '.version_select at 0x7f741820c820>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:15.397206 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-8115ecea-2e12-4f20-8292-ffd0f1ab28f6 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] HTTP exception thrown: Volume eb28bdde-f4db-48db-b935-acb031379227 could not be found. Apr 11 16:47:15.397796 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-8115ecea-2e12-4f20-8292-ffd0f1ab28f6 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Returning 404 to user: Volume eb28bdde-f4db-48db-b935-acb031379227 could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:47:15.398623 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-8115ecea-2e12-4f20-8292-ffd0f1ab28f6 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/eb28bdde-f4db-48db-b935-acb031379227" status: 404 len: 109 microversion: 2.1 time: 0.035717 Apr 11 16:47:15.399172 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 500/973] 10.222.0.65 () {58 vars in 1247 bytes} [Mon Apr 11 16:47:15 2022] DELETE /compute/v2.1/os-volumes/eb28bdde-f4db-48db-b935-acb031379227 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:47:15.408275 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-6d7a6760-a981-4bf0-96a5-a0f4712da9a7 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Calling method '.version_select at 0x7f7418175ee0>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:15.444435 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-6d7a6760-a981-4bf0-96a5-a0f4712da9a7 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] HTTP exception thrown: Volume eb28bdde-f4db-48db-b935-acb031379227 could not be found. Apr 11 16:47:15.445114 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-6d7a6760-a981-4bf0-96a5-a0f4712da9a7 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] Returning 404 to user: Volume eb28bdde-f4db-48db-b935-acb031379227 could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:47:15.446225 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-6d7a6760-a981-4bf0-96a5-a0f4712da9a7 tempest-VolumesSnapshotsTestJSON-1929101784 tempest-VolumesSnapshotsTestJSON-1929101784-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/eb28bdde-f4db-48db-b935-acb031379227" status: 404 len: 109 microversion: 2.1 time: 0.041870 Apr 11 16:47:15.446945 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 474/974] 10.222.0.65 () {58 vars in 1244 bytes} [Mon Apr 11 16:47:15 2022] GET /compute/v2.1/os-volumes/eb28bdde-f4db-48db-b935-acb031379227 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:47:15.955956 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-baaf2134-ef45-4cc4-a58b-34b4371c9c6a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:15.956846 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-baaf2134-ef45-4cc4-a58b-34b4371c9c6a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:15.964919 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-baaf2134-ef45-4cc4-a58b-34b4371c9c6a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:15.965358 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-baaf2134-ef45-4cc4-a58b-34b4371c9c6a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:15.966149 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-baaf2134-ef45-4cc4-a58b-34b4371c9c6a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:15.966604 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-baaf2134-ef45-4cc4-a58b-34b4371c9c6a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:15.982004 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-baaf2134-ef45-4cc4-a58b-34b4371c9c6a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] HTTP exception thrown: Instance bb39f773-fda3-4634-8e69-055b9315e3ba could not be found. Apr 11 16:47:15.982605 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-baaf2134-ef45-4cc4-a58b-34b4371c9c6a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Returning 404 to user: Instance bb39f773-fda3-4634-8e69-055b9315e3ba could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:47:15.983449 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-baaf2134-ef45-4cc4-a58b-34b4371c9c6a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 404 len: 111 microversion: 2.1 time: 0.032781 Apr 11 16:47:15.984048 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 501/975] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:15 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:47:16.133835 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a944139b-e6b7-4011-b249-d8809db325f7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1504712767", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1851676367", "security_groups": [{"name": "tempest-secgroup-smoke-1299759803"}], "block_device_mapping_v2": [{"uuid": "2d3f63cd-ed9b-4a08-949e-2724c84fc690", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c96476d8-c52f-4e3f-b8a6-4bfa7b594cfc"}]}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:47:16.276677 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.network.neutron [None req-a944139b-e6b7-4011-b249-d8809db325f7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] validate_networks() for [('c96476d8-c52f-4e3f-b8a6-4bfa7b594cfc', None, None, None, None, None)] {{(pid=123774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:47:16.749872 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-a944139b-e6b7-4011-b249-d8809db325f7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Flavor limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:47:16.751430 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-a944139b-e6b7-4011-b249-d8809db325f7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Image limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:47:16.751676 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-a944139b-e6b7-4011-b249-d8809db325f7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Flavor pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:47:16.752874 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-a944139b-e6b7-4011-b249-d8809db325f7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Image pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:47:16.753961 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-a944139b-e6b7-4011-b249-d8809db325f7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:47:16.773611 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a944139b-e6b7-4011-b249-d8809db325f7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:16.774585 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a944139b-e6b7-4011-b249-d8809db325f7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:16.776251 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a944139b-e6b7-4011-b249-d8809db325f7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:16.777030 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a944139b-e6b7-4011-b249-d8809db325f7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:16.799985 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-a944139b-e6b7-4011-b249-d8809db325f7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Getting quotas for project cc3803567a904d698675781a5ccd07cd. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:47:16.804389 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-a944139b-e6b7-4011-b249-d8809db325f7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Getting quotas for user 80844604b91746398c8ae7dde54d0dd3 and project cc3803567a904d698675781a5ccd07cd. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:47:16.872822 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a944139b-e6b7-4011-b249-d8809db325f7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Going to run 1 instances... {{(pid=123774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:47:16.875083 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a944139b-e6b7-4011-b249-d8809db325f7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2d3f63cd-ed9b-4a08-949e-2724c84fc690',volume_size=None,volume_type=None)] {{(pid=123774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:47:17.028506 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a944139b-e6b7-4011-b249-d8809db325f7 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.898634 Apr 11 16:47:17.029525 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 475/976] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Apr 11 16:47:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 16:47:17.043373 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a6b11a46-e9d4-4b74-9e49-0b496151568f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:17.044322 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a6b11a46-e9d4-4b74-9e49-0b496151568f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:17.118312 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a6b11a46-e9d4-4b74-9e49-0b496151568f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:17.124523 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-bf4eda6b-e7c3-4e47-b0dd-57291c9ff681 tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] Action: 'create', calling method: .version_select at 0x7f741c0ed430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-215559487", "metadata": {"Type": "work"}}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:47:17.126015 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-bf4eda6b-e7c3-4e47-b0dd-57291c9ff681 tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:47:17.126819 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-bf4eda6b-e7c3-4e47-b0dd-57291c9ff681 tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.148530 Apr 11 16:47:17.127586 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 502/977] 10.222.0.65 () {60 vars in 1155 bytes} [Mon Apr 11 16:47:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 11 16:47:17.128994 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a6b11a46-e9d4-4b74-9e49-0b496151568f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 200 len: 1095 microversion: 2.1 time: 0.091518 Apr 11 16:47:17.131342 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 476/978] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:17 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 1095 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:47:17.136762 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-6da5d7d5-715f-46f4-8bd8-4df1d6b7de43 tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] Action: 'create', calling method: .version_select at 0x7f741811eca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-411061751", "metadata": {"Type": "work"}}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:47:17.138821 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-6da5d7d5-715f-46f4-8bd8-4df1d6b7de43 tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:47:17.139617 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-6da5d7d5-715f-46f4-8bd8-4df1d6b7de43 tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006701 Apr 11 16:47:17.140209 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 503/979] 10.222.0.65 () {60 vars in 1155 bytes} [Mon Apr 11 16:47:17 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 16:47:17.149835 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-22d98dc3-d736-409d-ba6d-23cd562d5752 tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] Action: 'create', calling method: .version_select at 0x7f7418127dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1633372649", "metadata": {"Type": "work"}}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:47:17.151877 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-22d98dc3-d736-409d-ba6d-23cd562d5752 tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:47:17.152754 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-22d98dc3-d736-409d-ba6d-23cd562d5752 tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007029 Apr 11 16:47:17.153399 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 477/980] 10.222.0.65 () {60 vars in 1155 bytes} [Mon Apr 11 16:47:17 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 11 16:47:17.163376 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-7829ff51-5577-4e5d-8c18-32e02b290fca tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] Calling method '.version_select at 0x7f741bfebaf0>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:17.192631 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-7829ff51-5577-4e5d-8c18-32e02b290fca tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] HTTP exception thrown: Volume tempest-invalid-406227247 could not be found. Apr 11 16:47:17.194842 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-7829ff51-5577-4e5d-8c18-32e02b290fca tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] Returning 404 to user: Volume tempest-invalid-406227247 could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:47:17.195722 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-7829ff51-5577-4e5d-8c18-32e02b290fca tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/tempest-invalid-406227247" status: 404 len: 98 microversion: 2.1 time: 0.036897 Apr 11 16:47:17.196442 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 504/981] 10.222.0.65 () {58 vars in 1214 bytes} [Mon Apr 11 16:47:17 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-406227247 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 11 16:47:17.205634 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ff5895c8-6de8-4587-97e3-0a61c316a932 tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003891 Apr 11 16:47:17.206471 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 478/982] 10.222.0.65 () {58 vars in 1139 bytes} [Mon Apr 11 16:47:17 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 11 16:47:17.215485 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f297126c-49a0-4ae1-aff5-e8215a4ee8b9 tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003810 Apr 11 16:47:17.216019 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 505/983] 10.222.0.65 () {58 vars in 1136 bytes} [Mon Apr 11 16:47:17 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 11 16:47:17.225295 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-deca7c58-64eb-47c2-8627-b504081dfbf1 tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] Calling method '.version_select at 0x7f74184e0ee0>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:17.253392 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-deca7c58-64eb-47c2-8627-b504081dfbf1 tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] HTTP exception thrown: Volume ade0706e-1b52-4859-9a5d-1ea2fc9df7bc could not be found. Apr 11 16:47:17.253990 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-deca7c58-64eb-47c2-8627-b504081dfbf1 tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] Returning 404 to user: Volume ade0706e-1b52-4859-9a5d-1ea2fc9df7bc could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:47:17.254826 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-deca7c58-64eb-47c2-8627-b504081dfbf1 tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/ade0706e-1b52-4859-9a5d-1ea2fc9df7bc" status: 404 len: 109 microversion: 2.1 time: 0.033736 Apr 11 16:47:17.255382 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 479/984] 10.222.0.65 () {58 vars in 1247 bytes} [Mon Apr 11 16:47:17 2022] DELETE /compute/v2.1/os-volumes/ade0706e-1b52-4859-9a5d-1ea2fc9df7bc => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 16:47:17.265567 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-544c9cd9-0ebe-4ac8-869f-6997abfaa53c tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] Calling method '.version_select at 0x7f741bfebb80>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:17.301909 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-544c9cd9-0ebe-4ac8-869f-6997abfaa53c tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] HTTP exception thrown: Volume 62da9368-9fd2-4889-a3f1-94b3e1025fb0 could not be found. Apr 11 16:47:17.302632 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-544c9cd9-0ebe-4ac8-869f-6997abfaa53c tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] Returning 404 to user: Volume 62da9368-9fd2-4889-a3f1-94b3e1025fb0 could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:47:17.303606 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-544c9cd9-0ebe-4ac8-869f-6997abfaa53c tempest-VolumesNegativeTest-820120998 tempest-VolumesNegativeTest-820120998-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/62da9368-9fd2-4889-a3f1-94b3e1025fb0" status: 404 len: 109 microversion: 2.1 time: 0.042563 Apr 11 16:47:17.304286 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 506/985] 10.222.0.65 () {58 vars in 1244 bytes} [Mon Apr 11 16:47:17 2022] GET /compute/v2.1/os-volumes/62da9368-9fd2-4889-a3f1-94b3e1025fb0 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:47:18.148559 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-0c7eb433-81ce-4455-98f5-152c81fd816f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:18.150398 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-0c7eb433-81ce-4455-98f5-152c81fd816f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:18.166836 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0c7eb433-81ce-4455-98f5-152c81fd816f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:18.168182 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0c7eb433-81ce-4455-98f5-152c81fd816f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:18.170690 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0c7eb433-81ce-4455-98f5-152c81fd816f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:18.171793 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0c7eb433-81ce-4455-98f5-152c81fd816f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:18.282137 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0c7eb433-81ce-4455-98f5-152c81fd816f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:18.291953 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-0c7eb433-81ce-4455-98f5-152c81fd816f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 200 len: 1211 microversion: 2.1 time: 0.148920 Apr 11 16:47:18.292866 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 480/986] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:18 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 1211 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:47:19.320240 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c586e57c-df67-4413-90c0-4274016e8360 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:19.321092 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c586e57c-df67-4413-90c0-4274016e8360 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:19.329373 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c586e57c-df67-4413-90c0-4274016e8360 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:19.330069 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c586e57c-df67-4413-90c0-4274016e8360 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:19.331187 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c586e57c-df67-4413-90c0-4274016e8360 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:19.331896 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c586e57c-df67-4413-90c0-4274016e8360 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:19.572825 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c586e57c-df67-4413-90c0-4274016e8360 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:19.585411 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c586e57c-df67-4413-90c0-4274016e8360 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 200 len: 1267 microversion: 2.1 time: 0.270290 Apr 11 16:47:19.586876 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 507/987] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:19 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 1267 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:47:19.986942 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-9dc79f1a-d106-425b-bfca-67f23a866e57 req-746ab884-1f0a-4c19-9ab9-a4d79df70d18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd8e3633-0aab-4e07-ac19-252cc15604aa", "tag": "36b6fa9b-53fb-486f-bde2-16297771bdc7"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:47:20.019576 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-9dc79f1a-d106-425b-bfca-67f23a866e57 req-746ab884-1f0a-4c19-9ab9-a4d79df70d18 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:20.029648 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-9dc79f1a-d106-425b-bfca-67f23a866e57 req-746ab884-1f0a-4c19-9ab9-a4d79df70d18 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:20.056462 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-9dc79f1a-d106-425b-bfca-67f23a866e57 req-746ab884-1f0a-4c19-9ab9-a4d79df70d18 service nova] Creating event network-changed:36b6fa9b-53fb-486f-bde2-16297771bdc7 for instance bd8e3633-0aab-4e07-ac19-252cc15604aa on hv-cinder-83716 Apr 11 16:47:20.069670 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-9dc79f1a-d106-425b-bfca-67f23a866e57 req-746ab884-1f0a-4c19-9ab9-a4d79df70d18 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091014 Apr 11 16:47:20.075670 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 481/988] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:47:20.605055 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-74a7f27b-a892-4afc-91b3-2a3f24704c8f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:20.607205 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-74a7f27b-a892-4afc-91b3-2a3f24704c8f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:20.619220 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-74a7f27b-a892-4afc-91b3-2a3f24704c8f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:20.620371 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-74a7f27b-a892-4afc-91b3-2a3f24704c8f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:20.622220 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-74a7f27b-a892-4afc-91b3-2a3f24704c8f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:20.623049 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-74a7f27b-a892-4afc-91b3-2a3f24704c8f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:20.808622 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-74a7f27b-a892-4afc-91b3-2a3f24704c8f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:20.816558 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-74a7f27b-a892-4afc-91b3-2a3f24704c8f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 200 len: 1267 microversion: 2.1 time: 0.217506 Apr 11 16:47:20.817142 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 508/989] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:20 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 1267 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:47:21.836294 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d300f855-8334-43d6-b96b-bb6df4b535e8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:21.837076 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d300f855-8334-43d6-b96b-bb6df4b535e8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:21.843936 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d300f855-8334-43d6-b96b-bb6df4b535e8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:21.844350 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d300f855-8334-43d6-b96b-bb6df4b535e8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:21.845221 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d300f855-8334-43d6-b96b-bb6df4b535e8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:21.845571 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d300f855-8334-43d6-b96b-bb6df4b535e8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:22.008344 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d300f855-8334-43d6-b96b-bb6df4b535e8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:22.021394 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d300f855-8334-43d6-b96b-bb6df4b535e8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 200 len: 1267 microversion: 2.1 time: 0.189982 Apr 11 16:47:22.022399 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 482/990] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:21 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:47:23.046572 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f1b5da1f-5529-4404-9663-cf53596c95a5 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:23.047581 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f1b5da1f-5529-4404-9663-cf53596c95a5 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:23.054061 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f1b5da1f-5529-4404-9663-cf53596c95a5 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:23.054541 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f1b5da1f-5529-4404-9663-cf53596c95a5 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:23.055563 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f1b5da1f-5529-4404-9663-cf53596c95a5 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:23.056034 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f1b5da1f-5529-4404-9663-cf53596c95a5 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:23.227454 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f1b5da1f-5529-4404-9663-cf53596c95a5 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:23.236026 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f1b5da1f-5529-4404-9663-cf53596c95a5 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 200 len: 1267 microversion: 2.1 time: 0.193466 Apr 11 16:47:23.236725 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 509/991] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:23 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:47:24.258917 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-1e0ecebf-7d3b-471b-a17e-fe2fb8d4c735 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:24.259700 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-1e0ecebf-7d3b-471b-a17e-fe2fb8d4c735 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:24.268069 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1e0ecebf-7d3b-471b-a17e-fe2fb8d4c735 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:24.268907 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1e0ecebf-7d3b-471b-a17e-fe2fb8d4c735 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:24.269769 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1e0ecebf-7d3b-471b-a17e-fe2fb8d4c735 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:24.270425 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1e0ecebf-7d3b-471b-a17e-fe2fb8d4c735 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:24.516492 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-1e0ecebf-7d3b-471b-a17e-fe2fb8d4c735 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:24.525716 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-1e0ecebf-7d3b-471b-a17e-fe2fb8d4c735 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 200 len: 1267 microversion: 2.1 time: 0.273327 Apr 11 16:47:24.526407 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 483/992] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:24 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 1267 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:47:25.544132 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-e7b581b9-12e2-4962-b0fd-966b71fb0500 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:25.545693 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-e7b581b9-12e2-4962-b0fd-966b71fb0500 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:25.554075 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e7b581b9-12e2-4962-b0fd-966b71fb0500 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:25.554775 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e7b581b9-12e2-4962-b0fd-966b71fb0500 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:25.555796 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e7b581b9-12e2-4962-b0fd-966b71fb0500 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:25.556370 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e7b581b9-12e2-4962-b0fd-966b71fb0500 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:25.707377 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-e7b581b9-12e2-4962-b0fd-966b71fb0500 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:25.715032 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-e7b581b9-12e2-4962-b0fd-966b71fb0500 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 200 len: 1267 microversion: 2.1 time: 0.176048 Apr 11 16:47:25.715655 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 510/993] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:25 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:47:26.737681 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-2743fccd-7513-465c-b437-a55ba446730a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:26.739926 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-2743fccd-7513-465c-b437-a55ba446730a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:26.750281 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2743fccd-7513-465c-b437-a55ba446730a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:26.751088 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2743fccd-7513-465c-b437-a55ba446730a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:26.752673 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2743fccd-7513-465c-b437-a55ba446730a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:26.753436 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2743fccd-7513-465c-b437-a55ba446730a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:26.979146 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-2743fccd-7513-465c-b437-a55ba446730a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:26.990582 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-2743fccd-7513-465c-b437-a55ba446730a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 200 len: 1267 microversion: 2.1 time: 0.260201 Apr 11 16:47:26.991510 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 484/994] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:26 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 1267 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:47:28.009663 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-2b8584bb-5838-413b-8f91-2b3314b68b4f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:28.010170 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-2b8584bb-5838-413b-8f91-2b3314b68b4f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:28.017099 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2b8584bb-5838-413b-8f91-2b3314b68b4f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:28.017680 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2b8584bb-5838-413b-8f91-2b3314b68b4f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:28.019152 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2b8584bb-5838-413b-8f91-2b3314b68b4f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:28.019563 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2b8584bb-5838-413b-8f91-2b3314b68b4f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:28.191151 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-2b8584bb-5838-413b-8f91-2b3314b68b4f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:28.200291 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-2b8584bb-5838-413b-8f91-2b3314b68b4f tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 200 len: 1267 microversion: 2.1 time: 0.194788 Apr 11 16:47:28.200992 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 511/995] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:28 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:47:29.225906 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e63a116d-36cb-4a16-957d-c034e131fc14 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:29.226474 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e63a116d-36cb-4a16-957d-c034e131fc14 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:29.232963 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e63a116d-36cb-4a16-957d-c034e131fc14 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:29.233421 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e63a116d-36cb-4a16-957d-c034e131fc14 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:29.234208 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e63a116d-36cb-4a16-957d-c034e131fc14 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:29.234646 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e63a116d-36cb-4a16-957d-c034e131fc14 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:29.388665 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e63a116d-36cb-4a16-957d-c034e131fc14 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:29.398132 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e63a116d-36cb-4a16-957d-c034e131fc14 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 200 len: 1267 microversion: 2.1 time: 0.176943 Apr 11 16:47:29.398729 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 485/996] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:29 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:47:30.416088 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-2b2b6c6f-84c1-4f66-9044-97a2ee094e84 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:30.417671 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-2b2b6c6f-84c1-4f66-9044-97a2ee094e84 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:30.426728 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2b2b6c6f-84c1-4f66-9044-97a2ee094e84 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:30.427502 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2b2b6c6f-84c1-4f66-9044-97a2ee094e84 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:30.428360 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2b2b6c6f-84c1-4f66-9044-97a2ee094e84 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:30.428794 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2b2b6c6f-84c1-4f66-9044-97a2ee094e84 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:30.575378 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-2b2b6c6f-84c1-4f66-9044-97a2ee094e84 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:30.584178 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-2b2b6c6f-84c1-4f66-9044-97a2ee094e84 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 200 len: 1267 microversion: 2.1 time: 0.172418 Apr 11 16:47:30.585181 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 512/997] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:30 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:47:31.601292 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-b7a88100-7118-44a6-bb62-7236d98441dc tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:31.601912 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-b7a88100-7118-44a6-bb62-7236d98441dc tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:31.609296 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b7a88100-7118-44a6-bb62-7236d98441dc tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:31.609738 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b7a88100-7118-44a6-bb62-7236d98441dc tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:31.610545 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b7a88100-7118-44a6-bb62-7236d98441dc tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:31.611169 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-b7a88100-7118-44a6-bb62-7236d98441dc tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:31.779525 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-b7a88100-7118-44a6-bb62-7236d98441dc tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:31.788007 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-b7a88100-7118-44a6-bb62-7236d98441dc tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 200 len: 1267 microversion: 2.1 time: 0.190537 Apr 11 16:47:31.788876 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 486/998] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:31 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:47:32.563772 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-0f56a319-43c4-4e64-a8f1-1cc186a700ae req-1d509fdc-d8bb-41b7-93f5-7bcd1aed955a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd8e3633-0aab-4e07-ac19-252cc15604aa", "name": "network-vif-plugged", "status": "completed", "tag": "36b6fa9b-53fb-486f-bde2-16297771bdc7"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:47:32.572217 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-0f56a319-43c4-4e64-a8f1-1cc186a700ae req-1d509fdc-d8bb-41b7-93f5-7bcd1aed955a service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:32.572658 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-0f56a319-43c4-4e64-a8f1-1cc186a700ae req-1d509fdc-d8bb-41b7-93f5-7bcd1aed955a service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:32.585131 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-0f56a319-43c4-4e64-a8f1-1cc186a700ae req-1d509fdc-d8bb-41b7-93f5-7bcd1aed955a service nova] Creating event network-vif-plugged:36b6fa9b-53fb-486f-bde2-16297771bdc7 for instance bd8e3633-0aab-4e07-ac19-252cc15604aa on hv-cinder-83716 Apr 11 16:47:32.591045 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-0f56a319-43c4-4e64-a8f1-1cc186a700ae req-1d509fdc-d8bb-41b7-93f5-7bcd1aed955a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160545 Apr 11 16:47:32.591968 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 513/999] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:47:32.817552 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-898944d5-58bf-43cc-ac48-d51381bdffe3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:32.818174 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-898944d5-58bf-43cc-ac48-d51381bdffe3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:32.824880 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-898944d5-58bf-43cc-ac48-d51381bdffe3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:32.825327 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-898944d5-58bf-43cc-ac48-d51381bdffe3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:32.826140 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-898944d5-58bf-43cc-ac48-d51381bdffe3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:32.826584 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-898944d5-58bf-43cc-ac48-d51381bdffe3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:32.989845 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-898944d5-58bf-43cc-ac48-d51381bdffe3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:32.998976 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-898944d5-58bf-43cc-ac48-d51381bdffe3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 200 len: 1267 microversion: 2.1 time: 0.185400 Apr 11 16:47:32.999594 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 487/1000] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:32 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:47:34.018973 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d9c29da8-3a4c-4ef4-a8b2-00d8550bd3f6 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:34.019811 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d9c29da8-3a4c-4ef4-a8b2-00d8550bd3f6 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:34.026227 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d9c29da8-3a4c-4ef4-a8b2-00d8550bd3f6 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:34.026686 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d9c29da8-3a4c-4ef4-a8b2-00d8550bd3f6 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:34.027470 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d9c29da8-3a4c-4ef4-a8b2-00d8550bd3f6 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:34.027925 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d9c29da8-3a4c-4ef4-a8b2-00d8550bd3f6 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:34.217169 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d9c29da8-3a4c-4ef4-a8b2-00d8550bd3f6 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:34.231137 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d9c29da8-3a4c-4ef4-a8b2-00d8550bd3f6 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 200 len: 1267 microversion: 2.1 time: 0.217205 Apr 11 16:47:34.232274 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 514/1001] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:34 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:47:35.249934 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e140e05b-9a4f-4f8c-b329-9b86363222a0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:35.250874 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e140e05b-9a4f-4f8c-b329-9b86363222a0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:35.258224 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e140e05b-9a4f-4f8c-b329-9b86363222a0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:35.258666 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e140e05b-9a4f-4f8c-b329-9b86363222a0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:35.259435 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e140e05b-9a4f-4f8c-b329-9b86363222a0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:35.259890 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e140e05b-9a4f-4f8c-b329-9b86363222a0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:35.424916 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e140e05b-9a4f-4f8c-b329-9b86363222a0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:35.434148 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e140e05b-9a4f-4f8c-b329-9b86363222a0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 200 len: 1453 microversion: 2.1 time: 0.188645 Apr 11 16:47:35.434910 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 488/1002] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:35 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 1453 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:47:35.454534 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-e9a9b453-1a1f-4b47-adc3-011d27e65c12 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:47:35.455329 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-e9a9b453-1a1f-4b47-adc3-011d27e65c12 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:47:35.462050 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e9a9b453-1a1f-4b47-adc3-011d27e65c12 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:35.462243 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e9a9b453-1a1f-4b47-adc3-011d27e65c12 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:35.463135 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e9a9b453-1a1f-4b47-adc3-011d27e65c12 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:35.463569 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e9a9b453-1a1f-4b47-adc3-011d27e65c12 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:35.619295 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-e9a9b453-1a1f-4b47-adc3-011d27e65c12 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:47:35.626716 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-e9a9b453-1a1f-4b47-adc3-011d27e65c12 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 200 len: 1453 microversion: 2.1 time: 0.176136 Apr 11 16:47:35.627297 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 515/1003] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:47:35 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:47:37.492897 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-08c154f1-d494-472d-870a-1bc5fdaea182 req-1a66bb1d-c489-43ee-ba23-37680a4f93ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd8e3633-0aab-4e07-ac19-252cc15604aa", "tag": "36b6fa9b-53fb-486f-bde2-16297771bdc7"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:47:37.502311 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-08c154f1-d494-472d-870a-1bc5fdaea182 req-1a66bb1d-c489-43ee-ba23-37680a4f93ac service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:47:37.502903 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-08c154f1-d494-472d-870a-1bc5fdaea182 req-1a66bb1d-c489-43ee-ba23-37680a4f93ac service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:47:37.514419 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-08c154f1-d494-472d-870a-1bc5fdaea182 req-1a66bb1d-c489-43ee-ba23-37680a4f93ac service nova] Creating event network-changed:36b6fa9b-53fb-486f-bde2-16297771bdc7 for instance bd8e3633-0aab-4e07-ac19-252cc15604aa on hv-cinder-83716 Apr 11 16:47:37.519949 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-08c154f1-d494-472d-870a-1bc5fdaea182 req-1a66bb1d-c489-43ee-ba23-37680a4f93ac service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030997 Apr 11 16:47:37.520707 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 489/1004] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:48:20.332140 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-44a0f956-5d10-48bb-88b8-0c81f64ff12a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:48:20.332781 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-44a0f956-5d10-48bb-88b8-0c81f64ff12a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:48:20.339131 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-44a0f956-5d10-48bb-88b8-0c81f64ff12a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:20.339585 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-44a0f956-5d10-48bb-88b8-0c81f64ff12a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:20.340391 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-44a0f956-5d10-48bb-88b8-0c81f64ff12a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:20.340826 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-44a0f956-5d10-48bb-88b8-0c81f64ff12a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:20.365033 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-44a0f956-5d10-48bb-88b8-0c81f64ff12a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247/ips" status: 200 len: 149 microversion: 2.1 time: 0.037094 Apr 11 16:48:20.365611 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 516/1005] 10.222.0.65 () {58 vars in 1247 bytes} [Mon Apr 11 16:48:20 2022] GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:48:21.729509 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-dec86e31-029b-4dee-8a65-2238a0e97b33 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97e33904-8fce-4ced-b352-03b32d6947c2"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:48:21.731561 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-dec86e31-029b-4dee-8a65-2238a0e97b33 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:48:21.741876 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dec86e31-029b-4dee-8a65-2238a0e97b33 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:21.742335 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dec86e31-029b-4dee-8a65-2238a0e97b33 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:21.743157 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dec86e31-029b-4dee-8a65-2238a0e97b33 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:21.743667 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-dec86e31-029b-4dee-8a65-2238a0e97b33 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:21.981846 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-dec86e31-029b-4dee-8a65-2238a0e97b33 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "POST /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258872 Apr 11 16:48:21.982580 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 490/1006] 10.222.0.65 () {60 vars in 1322 bytes} [Mon Apr 11 16:48:21 2022] POST /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:48:29.490032 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-7fadb7e7-300a-4777-89d9-f339bf0c9155 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Action: 'create', calling method: .version_select at 0x7f741822d280>, body: {"keypair": {"name": "tempest-keypair-1206622482"}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:48:29.505235 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-7fadb7e7-300a-4777-89d9-f339bf0c9155 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:48:29.509204 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-7fadb7e7-300a-4777-89d9-f339bf0c9155 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for user 089723b908ba4a25bb83de445b69561d and project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:48:30.103271 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-7fadb7e7-300a-4777-89d9-f339bf0c9155 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:48:30.107124 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-7fadb7e7-300a-4777-89d9-f339bf0c9155 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for user 089723b908ba4a25bb83de445b69561d and project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:48:30.121438 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-7fadb7e7-300a-4777-89d9-f339bf0c9155 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.635547 Apr 11 16:48:30.122069 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 517/1007] 10.222.0.65 () {60 vars in 1157 bytes} [Mon Apr 11 16:48:29 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:48:31.450859 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-262c2d20-f42e-448a-9bbc-eceda33a393d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1803483106", "imageRef": "e989c938-7b7a-445c-aec9-596e81d35104", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64f8adf0-5b62-426a-b30a-0690e612962b"}], "security_groups": [{"name": "tempest-securitygroup--479692246"}], "key_name": "tempest-keypair-1206622482", "user_data": "}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:48:31.560596 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.network.neutron [None req-262c2d20-f42e-448a-9bbc-eceda33a393d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] validate_networks() for [('64f8adf0-5b62-426a-b30a-0690e612962b', None, None, None, None, None)] {{(pid=123774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:48:32.332024 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-262c2d20-f42e-448a-9bbc-eceda33a393d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Flavor limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:48:32.332548 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-262c2d20-f42e-448a-9bbc-eceda33a393d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Image limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:48:32.332925 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-262c2d20-f42e-448a-9bbc-eceda33a393d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Flavor pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:48:32.333451 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-262c2d20-f42e-448a-9bbc-eceda33a393d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Image pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:48:32.333737 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-262c2d20-f42e-448a-9bbc-eceda33a393d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:48:32.347431 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-262c2d20-f42e-448a-9bbc-eceda33a393d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:32.347919 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-262c2d20-f42e-448a-9bbc-eceda33a393d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:32.348727 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-262c2d20-f42e-448a-9bbc-eceda33a393d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:32.349164 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-262c2d20-f42e-448a-9bbc-eceda33a393d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:32.367454 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-262c2d20-f42e-448a-9bbc-eceda33a393d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:48:32.371569 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-262c2d20-f42e-448a-9bbc-eceda33a393d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for user 089723b908ba4a25bb83de445b69561d and project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:48:32.383597 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-262c2d20-f42e-448a-9bbc-eceda33a393d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Going to run 1 instances... {{(pid=123774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:48:32.386057 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-262c2d20-f42e-448a-9bbc-eceda33a393d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e989c938-7b7a-445c-aec9-596e81d35104',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:48:32.435494 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-262c2d20-f42e-448a-9bbc-eceda33a393d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.989843 Apr 11 16:48:32.436226 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 491/1008] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Apr 11 16:48:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 16:48:32.447070 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-104ada8b-203b-4be8-a5c1-14c733775841 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:48:32.447833 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-104ada8b-203b-4be8-a5c1-14c733775841 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:48:32.501501 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-104ada8b-203b-4be8-a5c1-14c733775841 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:48:32.508247 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-104ada8b-203b-4be8-a5c1-14c733775841 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5" status: 200 len: 1242 microversion: 2.1 time: 0.065759 Apr 11 16:48:32.508848 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 518/1009] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:48:32 2022] GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:48:33.526561 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ca4534b6-a49d-4976-a5bc-c8e90f65e4ec tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:48:33.527300 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ca4534b6-a49d-4976-a5bc-c8e90f65e4ec tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:48:33.534404 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ca4534b6-a49d-4976-a5bc-c8e90f65e4ec tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:33.535125 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ca4534b6-a49d-4976-a5bc-c8e90f65e4ec tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:33.536112 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ca4534b6-a49d-4976-a5bc-c8e90f65e4ec tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:33.536740 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ca4534b6-a49d-4976-a5bc-c8e90f65e4ec tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:33.606605 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ca4534b6-a49d-4976-a5bc-c8e90f65e4ec tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:48:33.615430 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ca4534b6-a49d-4976-a5bc-c8e90f65e4ec tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5" status: 200 len: 1312 microversion: 2.1 time: 0.092936 Apr 11 16:48:33.616730 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 492/1010] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:48:33 2022] GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:48:34.633040 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-818251be-a396-4ea3-bc35-c42a0b5c9312 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:48:34.634315 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-818251be-a396-4ea3-bc35-c42a0b5c9312 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:48:34.642572 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-818251be-a396-4ea3-bc35-c42a0b5c9312 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:34.643024 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-818251be-a396-4ea3-bc35-c42a0b5c9312 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:34.643827 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-818251be-a396-4ea3-bc35-c42a0b5c9312 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:34.644260 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-818251be-a396-4ea3-bc35-c42a0b5c9312 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:34.795405 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-818251be-a396-4ea3-bc35-c42a0b5c9312 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:48:34.813999 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-818251be-a396-4ea3-bc35-c42a0b5c9312 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5" status: 200 len: 1367 microversion: 2.1 time: 0.184788 Apr 11 16:48:34.814595 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 519/1011] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:48:34 2022] GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:48:35.115484 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-177aa7b3-e9c3-422a-b514-52f9d171115e req-e13fcdd3-c774-4c88-aa25-ba520d67fb5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ca07a6-3b06-4768-a6f8-0e88240dbad5", "tag": "5219d559-b60a-4bdd-9b16-9096f03e133d"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:48:35.123684 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-177aa7b3-e9c3-422a-b514-52f9d171115e req-e13fcdd3-c774-4c88-aa25-ba520d67fb5e service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:35.124584 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-177aa7b3-e9c3-422a-b514-52f9d171115e req-e13fcdd3-c774-4c88-aa25-ba520d67fb5e service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:35.136142 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-177aa7b3-e9c3-422a-b514-52f9d171115e req-e13fcdd3-c774-4c88-aa25-ba520d67fb5e service nova] Creating event network-changed:5219d559-b60a-4bdd-9b16-9096f03e133d for instance 23ca07a6-3b06-4768-a6f8-0e88240dbad5 on hv-cinder-83716 Apr 11 16:48:35.141419 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-177aa7b3-e9c3-422a-b514-52f9d171115e req-e13fcdd3-c774-4c88-aa25-ba520d67fb5e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226742 Apr 11 16:48:35.142048 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 493/1012] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:48:35.830837 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1a9bd5c7-8bb6-444e-bab3-2a8e68ceb1a9 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:48:35.831408 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1a9bd5c7-8bb6-444e-bab3-2a8e68ceb1a9 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:48:35.838263 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1a9bd5c7-8bb6-444e-bab3-2a8e68ceb1a9 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:35.838708 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1a9bd5c7-8bb6-444e-bab3-2a8e68ceb1a9 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:35.839466 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1a9bd5c7-8bb6-444e-bab3-2a8e68ceb1a9 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:35.839918 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1a9bd5c7-8bb6-444e-bab3-2a8e68ceb1a9 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:35.972870 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1a9bd5c7-8bb6-444e-bab3-2a8e68ceb1a9 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:48:35.980759 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1a9bd5c7-8bb6-444e-bab3-2a8e68ceb1a9 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5" status: 200 len: 1367 microversion: 2.1 time: 0.154022 Apr 11 16:48:35.981367 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 520/1013] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:48:35 2022] GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:48:36.999898 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-677564b1-b85d-4d64-91f6-cc5b961db613 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:48:37.000507 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-677564b1-b85d-4d64-91f6-cc5b961db613 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:48:37.007341 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-677564b1-b85d-4d64-91f6-cc5b961db613 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:37.007819 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-677564b1-b85d-4d64-91f6-cc5b961db613 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:37.008597 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-677564b1-b85d-4d64-91f6-cc5b961db613 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:37.009029 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-677564b1-b85d-4d64-91f6-cc5b961db613 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:37.154584 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-677564b1-b85d-4d64-91f6-cc5b961db613 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:48:37.162832 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-677564b1-b85d-4d64-91f6-cc5b961db613 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5" status: 200 len: 1367 microversion: 2.1 time: 0.167844 Apr 11 16:48:37.163454 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 494/1014] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:48:36 2022] GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:48:38.180636 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ffd23911-c94a-4850-abb4-abb54feb6b0e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:48:38.181276 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ffd23911-c94a-4850-abb4-abb54feb6b0e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:48:38.188709 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ffd23911-c94a-4850-abb4-abb54feb6b0e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:38.189165 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ffd23911-c94a-4850-abb4-abb54feb6b0e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:38.189976 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ffd23911-c94a-4850-abb4-abb54feb6b0e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:38.190498 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ffd23911-c94a-4850-abb4-abb54feb6b0e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:38.329464 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ffd23911-c94a-4850-abb4-abb54feb6b0e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:48:38.337245 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ffd23911-c94a-4850-abb4-abb54feb6b0e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5" status: 200 len: 1367 microversion: 2.1 time: 0.160616 Apr 11 16:48:38.337863 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 521/1015] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:48:38 2022] GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:48:39.355076 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-700386b3-5f55-4d74-8ead-f548621a4aa0 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:48:39.355706 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-700386b3-5f55-4d74-8ead-f548621a4aa0 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:48:39.363240 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-700386b3-5f55-4d74-8ead-f548621a4aa0 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:39.363679 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-700386b3-5f55-4d74-8ead-f548621a4aa0 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:39.364480 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-700386b3-5f55-4d74-8ead-f548621a4aa0 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:39.364909 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-700386b3-5f55-4d74-8ead-f548621a4aa0 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:39.504815 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-700386b3-5f55-4d74-8ead-f548621a4aa0 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:48:39.512434 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-700386b3-5f55-4d74-8ead-f548621a4aa0 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5" status: 200 len: 1367 microversion: 2.1 time: 0.161350 Apr 11 16:48:39.513026 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 495/1016] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:48:39 2022] GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:48:40.530212 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-234f652b-37b8-4615-a70d-6f3e4b72bea1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:48:40.530900 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-234f652b-37b8-4615-a70d-6f3e4b72bea1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:48:40.537605 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-234f652b-37b8-4615-a70d-6f3e4b72bea1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:40.538077 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-234f652b-37b8-4615-a70d-6f3e4b72bea1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:40.538812 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-234f652b-37b8-4615-a70d-6f3e4b72bea1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:40.539240 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-234f652b-37b8-4615-a70d-6f3e4b72bea1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:40.671054 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-234f652b-37b8-4615-a70d-6f3e4b72bea1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:48:40.678678 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-234f652b-37b8-4615-a70d-6f3e4b72bea1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5" status: 200 len: 1367 microversion: 2.1 time: 0.152470 Apr 11 16:48:40.679261 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 522/1017] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:48:40 2022] GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:48:40.805825 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-4a6136f4-80fa-43ec-bd53-c083b26a4273 req-9e448065-a8bd-4373-889d-5a6cda3cd40f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ca07a6-3b06-4768-a6f8-0e88240dbad5", "name": "network-vif-plugged", "status": "completed", "tag": "5219d559-b60a-4bdd-9b16-9096f03e133d"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:48:40.815156 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-4a6136f4-80fa-43ec-bd53-c083b26a4273 req-9e448065-a8bd-4373-889d-5a6cda3cd40f service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:40.815559 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-4a6136f4-80fa-43ec-bd53-c083b26a4273 req-9e448065-a8bd-4373-889d-5a6cda3cd40f service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:40.828763 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-4a6136f4-80fa-43ec-bd53-c083b26a4273 req-9e448065-a8bd-4373-889d-5a6cda3cd40f service nova] Creating event network-vif-plugged:5219d559-b60a-4bdd-9b16-9096f03e133d for instance 23ca07a6-3b06-4768-a6f8-0e88240dbad5 on hv-cinder-83716 Apr 11 16:48:40.833866 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-4a6136f4-80fa-43ec-bd53-c083b26a4273 req-9e448065-a8bd-4373-889d-5a6cda3cd40f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031924 Apr 11 16:48:40.834628 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 496/1018] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:48:41.696457 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-595d4981-bda6-4782-b58f-f218a98274c1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:48:41.697064 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-595d4981-bda6-4782-b58f-f218a98274c1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:48:41.704136 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-595d4981-bda6-4782-b58f-f218a98274c1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:41.704587 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-595d4981-bda6-4782-b58f-f218a98274c1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:41.705387 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-595d4981-bda6-4782-b58f-f218a98274c1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:41.705812 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-595d4981-bda6-4782-b58f-f218a98274c1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:41.837850 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-595d4981-bda6-4782-b58f-f218a98274c1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:48:41.845981 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-595d4981-bda6-4782-b58f-f218a98274c1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5" status: 200 len: 1367 microversion: 2.1 time: 0.153584 Apr 11 16:48:41.846556 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 523/1019] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:48:41 2022] GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:48:42.864897 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-054c7633-f2ad-4138-9ad0-161aaa5ec997 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:48:42.865853 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-054c7633-f2ad-4138-9ad0-161aaa5ec997 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:48:42.872722 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-054c7633-f2ad-4138-9ad0-161aaa5ec997 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:42.873173 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-054c7633-f2ad-4138-9ad0-161aaa5ec997 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:42.874005 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-054c7633-f2ad-4138-9ad0-161aaa5ec997 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:42.874428 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-054c7633-f2ad-4138-9ad0-161aaa5ec997 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:43.009258 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-054c7633-f2ad-4138-9ad0-161aaa5ec997 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:48:43.018584 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-054c7633-f2ad-4138-9ad0-161aaa5ec997 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5" status: 200 len: 1556 microversion: 2.1 time: 0.159566 Apr 11 16:48:43.019175 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 497/1020] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:48:42 2022] GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:48:43.035127 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b5a1ee62-4c41-476b-8745-c34a2babb12c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:48:43.035623 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b5a1ee62-4c41-476b-8745-c34a2babb12c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:48:43.042464 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b5a1ee62-4c41-476b-8745-c34a2babb12c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:43.042914 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b5a1ee62-4c41-476b-8745-c34a2babb12c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:43.043753 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b5a1ee62-4c41-476b-8745-c34a2babb12c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:43.044144 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b5a1ee62-4c41-476b-8745-c34a2babb12c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:43.124598 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b5a1ee62-4c41-476b-8745-c34a2babb12c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093429 Apr 11 16:48:43.125256 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 524/1021] 10.222.0.65 () {58 vars in 1274 bytes} [Mon Apr 11 16:48:43 2022] GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:48:44.130233 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-b2b331b0-c886-437f-bbbf-d9022ab7d757 req-e0e4b285-b4ef-4c91-8173-206050ede6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ca07a6-3b06-4768-a6f8-0e88240dbad5", "tag": "5219d559-b60a-4bdd-9b16-9096f03e133d"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:48:44.138700 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-b2b331b0-c886-437f-bbbf-d9022ab7d757 req-e0e4b285-b4ef-4c91-8173-206050ede6d8 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:48:44.139139 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-b2b331b0-c886-437f-bbbf-d9022ab7d757 req-e0e4b285-b4ef-4c91-8173-206050ede6d8 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:48:44.150577 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-b2b331b0-c886-437f-bbbf-d9022ab7d757 req-e0e4b285-b4ef-4c91-8173-206050ede6d8 service nova] Creating event network-changed:5219d559-b60a-4bdd-9b16-9096f03e133d for instance 23ca07a6-3b06-4768-a6f8-0e88240dbad5 on hv-cinder-83716 Apr 11 16:48:44.156726 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-b2b331b0-c886-437f-bbbf-d9022ab7d757 req-e0e4b285-b4ef-4c91-8173-206050ede6d8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029582 Apr 11 16:48:44.157533 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 498/1022] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:48:51.357947 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:48:51.358563 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: Mon Apr 11 16:48:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 16:49:50.671467 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3d573a20-218d-41d3-972e-3ba514440dd2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1812982781", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1851676367", "security_groups": [{"name": "tempest-secgroup-smoke-1299759803"}], "block_device_mapping_v2": [{"uuid": "edf09c53-e516-4f55-87a7-54eee6f4d952", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c96476d8-c52f-4e3f-b8a6-4bfa7b594cfc"}]}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:49:50.790107 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.network.neutron [None req-3d573a20-218d-41d3-972e-3ba514440dd2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] validate_networks() for [('c96476d8-c52f-4e3f-b8a6-4bfa7b594cfc', None, None, None, None, None)] {{(pid=123773) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:49:51.211143 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-3d573a20-218d-41d3-972e-3ba514440dd2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Flavor limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:49:51.211564 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-3d573a20-218d-41d3-972e-3ba514440dd2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Image limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:49:51.212069 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-3d573a20-218d-41d3-972e-3ba514440dd2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Flavor pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:49:51.212474 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-3d573a20-218d-41d3-972e-3ba514440dd2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Image pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:49:51.212906 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-3d573a20-218d-41d3-972e-3ba514440dd2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:49:51.222669 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3d573a20-218d-41d3-972e-3ba514440dd2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:49:51.223113 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3d573a20-218d-41d3-972e-3ba514440dd2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:49:51.223933 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3d573a20-218d-41d3-972e-3ba514440dd2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:49:51.224344 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3d573a20-218d-41d3-972e-3ba514440dd2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:49:51.242229 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-3d573a20-218d-41d3-972e-3ba514440dd2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Getting quotas for project cc3803567a904d698675781a5ccd07cd. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:49:51.246767 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-3d573a20-218d-41d3-972e-3ba514440dd2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Getting quotas for user 80844604b91746398c8ae7dde54d0dd3 and project cc3803567a904d698675781a5ccd07cd. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:49:51.305879 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3d573a20-218d-41d3-972e-3ba514440dd2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Going to run 1 instances... {{(pid=123773) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:49:51.308095 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3d573a20-218d-41d3-972e-3ba514440dd2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='edf09c53-e516-4f55-87a7-54eee6f4d952',volume_size=None,volume_type=None)] {{(pid=123773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:49:51.449940 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3d573a20-218d-41d3-972e-3ba514440dd2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.783916 Apr 11 16:49:51.450608 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 525/1023] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Apr 11 16:49:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 16:49:51.462837 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-4af89f88-3247-4787-b8ac-216ae1d5d8a8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:49:51.463531 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-4af89f88-3247-4787-b8ac-216ae1d5d8a8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:49:51.522785 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-4af89f88-3247-4787-b8ac-216ae1d5d8a8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:49:51.530246 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-4af89f88-3247-4787-b8ac-216ae1d5d8a8 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1095 microversion: 2.1 time: 0.073012 Apr 11 16:49:51.530829 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 499/1024] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:49:51 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:49:52.547442 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ca63fe92-89c1-494c-8cdd-02ecaef130bf tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:49:52.547959 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ca63fe92-89c1-494c-8cdd-02ecaef130bf tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:49:52.600748 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ca63fe92-89c1-494c-8cdd-02ecaef130bf tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:49:52.607661 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ca63fe92-89c1-494c-8cdd-02ecaef130bf tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1095 microversion: 2.1 time: 0.064872 Apr 11 16:49:52.608199 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 526/1025] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:49:52 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:49:53.624846 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-72daaa19-dde2-40cf-9514-2e8846915105 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:49:53.625449 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-72daaa19-dde2-40cf-9514-2e8846915105 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:49:53.678657 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-72daaa19-dde2-40cf-9514-2e8846915105 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:49:53.686129 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-72daaa19-dde2-40cf-9514-2e8846915105 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1095 microversion: 2.1 time: 0.065387 Apr 11 16:49:53.686706 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 500/1026] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:49:53 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:49:54.703014 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-16ce509a-d4d6-4949-8ab8-c4a7ee77827c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:49:54.703620 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-16ce509a-d4d6-4949-8ab8-c4a7ee77827c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:49:54.758989 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-16ce509a-d4d6-4949-8ab8-c4a7ee77827c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:49:54.766043 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-16ce509a-d4d6-4949-8ab8-c4a7ee77827c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1095 microversion: 2.1 time: 0.067376 Apr 11 16:49:54.766649 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 527/1027] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:49:54 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:49:55.783274 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-3e3c63ed-1b44-40a4-93c5-ca1d3a4b473a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:49:55.783956 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-3e3c63ed-1b44-40a4-93c5-ca1d3a4b473a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:49:55.790710 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3e3c63ed-1b44-40a4-93c5-ca1d3a4b473a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:49:55.791158 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3e3c63ed-1b44-40a4-93c5-ca1d3a4b473a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:49:55.791988 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3e3c63ed-1b44-40a4-93c5-ca1d3a4b473a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:49:55.792427 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-3e3c63ed-1b44-40a4-93c5-ca1d3a4b473a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:49:55.855133 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-3e3c63ed-1b44-40a4-93c5-ca1d3a4b473a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:49:55.863557 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-3e3c63ed-1b44-40a4-93c5-ca1d3a4b473a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1145 microversion: 2.1 time: 0.084152 Apr 11 16:49:55.864184 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 501/1028] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:49:55 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:49:56.881613 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-e78c1f76-1040-4640-bc67-83ce3c41c108 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:49:56.882959 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-e78c1f76-1040-4640-bc67-83ce3c41c108 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:49:56.892590 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e78c1f76-1040-4640-bc67-83ce3c41c108 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:49:56.893342 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e78c1f76-1040-4640-bc67-83ce3c41c108 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:49:56.894338 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e78c1f76-1040-4640-bc67-83ce3c41c108 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:49:56.895315 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e78c1f76-1040-4640-bc67-83ce3c41c108 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:49:56.962403 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-e78c1f76-1040-4640-bc67-83ce3c41c108 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:49:56.973112 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-e78c1f76-1040-4640-bc67-83ce3c41c108 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1211 microversion: 2.1 time: 0.096028 Apr 11 16:49:56.973704 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 528/1029] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:49:56 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:49:57.817829 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-a6eff7b4-ea70-4f8c-9f61-6812dc557934 req-24b63ddd-e70e-409d-bbe2-2031f09d8335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7c72056-5711-4122-8a5d-9f630cc79f32", "tag": "3a93865f-350d-4374-af08-1bab5e9726e5"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:49:57.828609 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-a6eff7b4-ea70-4f8c-9f61-6812dc557934 req-24b63ddd-e70e-409d-bbe2-2031f09d8335 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:49:57.829291 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-a6eff7b4-ea70-4f8c-9f61-6812dc557934 req-24b63ddd-e70e-409d-bbe2-2031f09d8335 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:49:57.841377 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-a6eff7b4-ea70-4f8c-9f61-6812dc557934 req-24b63ddd-e70e-409d-bbe2-2031f09d8335 service nova] Creating event network-changed:3a93865f-350d-4374-af08-1bab5e9726e5 for instance c7c72056-5711-4122-8a5d-9f630cc79f32 on hv-cinder-83716 Apr 11 16:49:57.847021 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-a6eff7b4-ea70-4f8c-9f61-6812dc557934 req-24b63ddd-e70e-409d-bbe2-2031f09d8335 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033180 Apr 11 16:49:57.847901 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 502/1030] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:49:57.990979 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-902ad2a3-880d-4f3f-a0a2-a64b3e53e12e tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:49:57.991770 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-902ad2a3-880d-4f3f-a0a2-a64b3e53e12e tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:49:57.998266 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-902ad2a3-880d-4f3f-a0a2-a64b3e53e12e tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:49:57.998749 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-902ad2a3-880d-4f3f-a0a2-a64b3e53e12e tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:49:57.999608 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-902ad2a3-880d-4f3f-a0a2-a64b3e53e12e tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:49:58.000165 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-902ad2a3-880d-4f3f-a0a2-a64b3e53e12e tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:49:58.148112 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-902ad2a3-880d-4f3f-a0a2-a64b3e53e12e tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:49:58.156379 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-902ad2a3-880d-4f3f-a0a2-a64b3e53e12e tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1267 microversion: 2.1 time: 0.169149 Apr 11 16:49:58.157377 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 529/1031] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:49:57 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:49:59.176008 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-7dcd4526-ca37-4f2a-af4e-3835e1dabff3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:49:59.176612 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-7dcd4526-ca37-4f2a-af4e-3835e1dabff3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:49:59.185742 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7dcd4526-ca37-4f2a-af4e-3835e1dabff3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:49:59.186261 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7dcd4526-ca37-4f2a-af4e-3835e1dabff3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:49:59.187071 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7dcd4526-ca37-4f2a-af4e-3835e1dabff3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:49:59.187496 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7dcd4526-ca37-4f2a-af4e-3835e1dabff3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:49:59.328515 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-7dcd4526-ca37-4f2a-af4e-3835e1dabff3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:49:59.336787 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-7dcd4526-ca37-4f2a-af4e-3835e1dabff3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1267 microversion: 2.1 time: 0.165907 Apr 11 16:49:59.337359 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 503/1032] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:49:59 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:00.354251 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-53428060-dc99-4826-85ef-ed7894c537b2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:00.354855 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-53428060-dc99-4826-85ef-ed7894c537b2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:00.362267 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-53428060-dc99-4826-85ef-ed7894c537b2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:00.362721 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-53428060-dc99-4826-85ef-ed7894c537b2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:00.363501 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-53428060-dc99-4826-85ef-ed7894c537b2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:00.363974 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-53428060-dc99-4826-85ef-ed7894c537b2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:00.503654 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-53428060-dc99-4826-85ef-ed7894c537b2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:00.511248 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-53428060-dc99-4826-85ef-ed7894c537b2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1267 microversion: 2.1 time: 0.161151 Apr 11 16:50:00.511866 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 530/1033] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:00 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:01.530971 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f358ecc4-a5cc-4e89-8462-25cdc5518e22 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:01.531817 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f358ecc4-a5cc-4e89-8462-25cdc5518e22 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:01.539202 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f358ecc4-a5cc-4e89-8462-25cdc5518e22 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:01.539665 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f358ecc4-a5cc-4e89-8462-25cdc5518e22 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:01.540459 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f358ecc4-a5cc-4e89-8462-25cdc5518e22 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:01.540894 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f358ecc4-a5cc-4e89-8462-25cdc5518e22 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:01.674127 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f358ecc4-a5cc-4e89-8462-25cdc5518e22 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:01.681641 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f358ecc4-a5cc-4e89-8462-25cdc5518e22 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1267 microversion: 2.1 time: 0.156217 Apr 11 16:50:01.682255 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 504/1034] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:01 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:02.699106 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-84529199-0221-4000-b650-d7de9fdc7062 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:02.700013 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-84529199-0221-4000-b650-d7de9fdc7062 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:02.706856 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-84529199-0221-4000-b650-d7de9fdc7062 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:02.707304 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-84529199-0221-4000-b650-d7de9fdc7062 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:02.708113 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-84529199-0221-4000-b650-d7de9fdc7062 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:02.708546 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-84529199-0221-4000-b650-d7de9fdc7062 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:02.846864 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-84529199-0221-4000-b650-d7de9fdc7062 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:02.857293 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-84529199-0221-4000-b650-d7de9fdc7062 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1267 microversion: 2.1 time: 0.161920 Apr 11 16:50:02.858170 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 531/1035] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:02 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:03.879100 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-7609ce1e-401b-44f1-b69a-7b5ed3f7fbdc tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:03.879767 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-7609ce1e-401b-44f1-b69a-7b5ed3f7fbdc tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:03.888716 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7609ce1e-401b-44f1-b69a-7b5ed3f7fbdc tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:03.889144 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7609ce1e-401b-44f1-b69a-7b5ed3f7fbdc tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:03.889931 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7609ce1e-401b-44f1-b69a-7b5ed3f7fbdc tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:03.890372 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7609ce1e-401b-44f1-b69a-7b5ed3f7fbdc tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:04.053774 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-7609ce1e-401b-44f1-b69a-7b5ed3f7fbdc tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:04.061534 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-7609ce1e-401b-44f1-b69a-7b5ed3f7fbdc tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1267 microversion: 2.1 time: 0.186406 Apr 11 16:50:04.062108 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 505/1036] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:03 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:05.078408 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-893ed8bd-6da4-4c20-bc3a-9f790acdacc0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:05.079027 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-893ed8bd-6da4-4c20-bc3a-9f790acdacc0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:05.085880 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-893ed8bd-6da4-4c20-bc3a-9f790acdacc0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:05.086329 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-893ed8bd-6da4-4c20-bc3a-9f790acdacc0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:05.087101 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-893ed8bd-6da4-4c20-bc3a-9f790acdacc0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:05.087526 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-893ed8bd-6da4-4c20-bc3a-9f790acdacc0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:05.220209 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-893ed8bd-6da4-4c20-bc3a-9f790acdacc0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:05.227991 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-893ed8bd-6da4-4c20-bc3a-9f790acdacc0 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1267 microversion: 2.1 time: 0.153497 Apr 11 16:50:05.228565 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 532/1037] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:05 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:06.246178 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-7b292a69-4edb-4c02-ae4b-7df88bd3026c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:06.246944 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-7b292a69-4edb-4c02-ae4b-7df88bd3026c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:06.253646 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7b292a69-4edb-4c02-ae4b-7df88bd3026c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:06.254065 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7b292a69-4edb-4c02-ae4b-7df88bd3026c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:06.254850 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7b292a69-4edb-4c02-ae4b-7df88bd3026c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:06.255253 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7b292a69-4edb-4c02-ae4b-7df88bd3026c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:06.393812 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-7b292a69-4edb-4c02-ae4b-7df88bd3026c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:06.401330 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-7b292a69-4edb-4c02-ae4b-7df88bd3026c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1267 microversion: 2.1 time: 0.159211 Apr 11 16:50:06.401975 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 506/1038] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:06 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:07.419215 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f0d0e8e9-09e2-407a-b4d3-78a75a38b07a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:07.419818 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f0d0e8e9-09e2-407a-b4d3-78a75a38b07a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:07.426617 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f0d0e8e9-09e2-407a-b4d3-78a75a38b07a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:07.427066 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f0d0e8e9-09e2-407a-b4d3-78a75a38b07a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:07.427909 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f0d0e8e9-09e2-407a-b4d3-78a75a38b07a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:07.428338 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f0d0e8e9-09e2-407a-b4d3-78a75a38b07a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:07.567263 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f0d0e8e9-09e2-407a-b4d3-78a75a38b07a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:07.575659 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f0d0e8e9-09e2-407a-b4d3-78a75a38b07a tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1267 microversion: 2.1 time: 0.160894 Apr 11 16:50:07.576245 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 533/1039] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:07 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:08.593097 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-7a83374b-8f45-4dcf-8dbf-b21601d74f8d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:08.593701 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-7a83374b-8f45-4dcf-8dbf-b21601d74f8d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:08.600438 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7a83374b-8f45-4dcf-8dbf-b21601d74f8d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:08.600879 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7a83374b-8f45-4dcf-8dbf-b21601d74f8d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:08.601636 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7a83374b-8f45-4dcf-8dbf-b21601d74f8d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:08.602060 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7a83374b-8f45-4dcf-8dbf-b21601d74f8d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:08.737706 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-7a83374b-8f45-4dcf-8dbf-b21601d74f8d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:08.745928 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-7a83374b-8f45-4dcf-8dbf-b21601d74f8d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1267 microversion: 2.1 time: 0.156789 Apr 11 16:50:08.746627 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 507/1040] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:08 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:09.244746 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-2bfd363b-d4f7-4809-894b-8601e2ab8f24 req-57386190-eb35-41f8-92a1-207fc061dcdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7c72056-5711-4122-8a5d-9f630cc79f32", "name": "network-vif-plugged", "status": "completed", "tag": "3a93865f-350d-4374-af08-1bab5e9726e5"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:50:09.256952 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-2bfd363b-d4f7-4809-894b-8601e2ab8f24 req-57386190-eb35-41f8-92a1-207fc061dcdd service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:09.257569 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-2bfd363b-d4f7-4809-894b-8601e2ab8f24 req-57386190-eb35-41f8-92a1-207fc061dcdd service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:09.270880 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-2bfd363b-d4f7-4809-894b-8601e2ab8f24 req-57386190-eb35-41f8-92a1-207fc061dcdd service nova] Creating event network-vif-plugged:3a93865f-350d-4374-af08-1bab5e9726e5 for instance c7c72056-5711-4122-8a5d-9f630cc79f32 on hv-cinder-83716 Apr 11 16:50:09.274466 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: ERROR oslo.messaging._drivers.impl_rabbit [req-2bfd363b-d4f7-4809-894b-8601e2ab8f24 req-57386190-eb35-41f8-92a1-207fc061dcdd service nova] [cf0de054-06fa-4074-9b54-3a90c4d9de14] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 16:50:09.763680 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ac8cd544-e4ac-4392-9151-8924c34dd20c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:09.764293 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ac8cd544-e4ac-4392-9151-8924c34dd20c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:09.771100 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ac8cd544-e4ac-4392-9151-8924c34dd20c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:09.771539 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ac8cd544-e4ac-4392-9151-8924c34dd20c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:09.772344 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ac8cd544-e4ac-4392-9151-8924c34dd20c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:09.772796 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ac8cd544-e4ac-4392-9151-8924c34dd20c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:09.908373 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ac8cd544-e4ac-4392-9151-8924c34dd20c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:09.916457 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ac8cd544-e4ac-4392-9151-8924c34dd20c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1267 microversion: 2.1 time: 0.156878 Apr 11 16:50:09.917040 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 508/1041] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:09 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:10.283918 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO oslo.messaging._drivers.impl_rabbit [req-2bfd363b-d4f7-4809-894b-8601e2ab8f24 req-57386190-eb35-41f8-92a1-207fc061dcdd service nova] [cf0de054-06fa-4074-9b54-3a90c4d9de14] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 36886. Apr 11 16:50:10.288367 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-2bfd363b-d4f7-4809-894b-8601e2ab8f24 req-57386190-eb35-41f8-92a1-207fc061dcdd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.048104 Apr 11 16:50:10.289160 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 534/1042] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:50:10.933964 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-15dc0f0d-5350-492d-bda6-10448b7a2f57 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:10.934596 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-15dc0f0d-5350-492d-bda6-10448b7a2f57 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:10.941181 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-15dc0f0d-5350-492d-bda6-10448b7a2f57 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:10.941644 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-15dc0f0d-5350-492d-bda6-10448b7a2f57 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:10.942408 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-15dc0f0d-5350-492d-bda6-10448b7a2f57 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:10.942842 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-15dc0f0d-5350-492d-bda6-10448b7a2f57 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:11.052956 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ec76d24b-114a-49fd-8c36-3273d5ed453d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:11.053623 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ec76d24b-114a-49fd-8c36-3273d5ed453d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:11.060619 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ec76d24b-114a-49fd-8c36-3273d5ed453d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:11.061121 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ec76d24b-114a-49fd-8c36-3273d5ed453d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:11.061918 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ec76d24b-114a-49fd-8c36-3273d5ed453d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:11.062350 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ec76d24b-114a-49fd-8c36-3273d5ed453d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:11.076972 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-15dc0f0d-5350-492d-bda6-10448b7a2f57 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:11.084855 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-15dc0f0d-5350-492d-bda6-10448b7a2f57 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1267 microversion: 2.1 time: 0.155149 Apr 11 16:50:11.085416 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 509/1043] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:10 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:11.086484 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ec76d24b-114a-49fd-8c36-3273d5ed453d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5/ips" status: 200 len: 148 microversion: 2.1 time: 0.037751 Apr 11 16:50:11.087040 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 535/1044] 10.222.0.65 () {58 vars in 1247 bytes} [Mon Apr 11 16:50:11 2022] GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:50:11.098579 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ccae3d2b-8e6d-425d-b812-ad1de027f6b8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97e33904-8fce-4ced-b352-03b32d6947c2"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:50:11.099681 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ccae3d2b-8e6d-425d-b812-ad1de027f6b8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:11.106178 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ccae3d2b-8e6d-425d-b812-ad1de027f6b8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:11.106627 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ccae3d2b-8e6d-425d-b812-ad1de027f6b8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:11.107411 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ccae3d2b-8e6d-425d-b812-ad1de027f6b8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:11.107863 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ccae3d2b-8e6d-425d-b812-ad1de027f6b8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:11.191467 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-ccae3d2b-8e6d-425d-b812-ad1de027f6b8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] HTTP exception thrown: Invalid volume: volume 97e33904-8fce-4ced-b352-03b32d6947c2 is already attached to instances: f8ba9b74-1ca3-4c03-b88e-c398753a5247 Apr 11 16:50:11.192024 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ccae3d2b-8e6d-425d-b812-ad1de027f6b8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Returning 400 to user: Invalid volume: volume 97e33904-8fce-4ced-b352-03b32d6947c2 is already attached to instances: f8ba9b74-1ca3-4c03-b88e-c398753a5247 {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:50:11.192876 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ccae3d2b-8e6d-425d-b812-ad1de027f6b8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "POST /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098594 Apr 11 16:50:11.193490 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 510/1045] 10.222.0.65 () {60 vars in 1322 bytes} [Mon Apr 11 16:50:11 2022] POST /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 16:50:11.204940 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-79b32fca-07e7-4dfd-a160-e2729c47aa9a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:11.204940 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-79b32fca-07e7-4dfd-a160-e2729c47aa9a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:11.209408 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-79b32fca-07e7-4dfd-a160-e2729c47aa9a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:11.209855 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-79b32fca-07e7-4dfd-a160-e2729c47aa9a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:11.210733 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-79b32fca-07e7-4dfd-a160-e2729c47aa9a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:11.211008 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-79b32fca-07e7-4dfd-a160-e2729c47aa9a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:11.236965 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-79b32fca-07e7-4dfd-a160-e2729c47aa9a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Going to try to terminate instance {{(pid=123773) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:50:11.314636 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-79b32fca-07e7-4dfd-a160-e2729c47aa9a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "DELETE /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5" status: 204 len: 0 microversion: 2.1 time: 0.116239 Apr 11 16:50:11.315334 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 536/1046] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:50:11 2022] DELETE /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:50:11.323505 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-12d1a9fc-2996-45aa-a623-6935e39c4cee tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:11.324291 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-12d1a9fc-2996-45aa-a623-6935e39c4cee tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:11.331397 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-12d1a9fc-2996-45aa-a623-6935e39c4cee tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:11.331882 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-12d1a9fc-2996-45aa-a623-6935e39c4cee tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:11.332654 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-12d1a9fc-2996-45aa-a623-6935e39c4cee tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:11.333081 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-12d1a9fc-2996-45aa-a623-6935e39c4cee tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:11.471600 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-12d1a9fc-2996-45aa-a623-6935e39c4cee tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:11.482060 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-12d1a9fc-2996-45aa-a623-6935e39c4cee tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5" status: 200 len: 1680 microversion: 2.1 time: 0.162426 Apr 11 16:50:11.482622 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 511/1047] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:11 2022] GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:12.102631 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-588a53ff-62c9-44b4-9055-2851e92dadf2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:12.103325 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-588a53ff-62c9-44b4-9055-2851e92dadf2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:12.111970 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-588a53ff-62c9-44b4-9055-2851e92dadf2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:12.112427 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-588a53ff-62c9-44b4-9055-2851e92dadf2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:12.113741 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-588a53ff-62c9-44b4-9055-2851e92dadf2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:12.114331 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-588a53ff-62c9-44b4-9055-2851e92dadf2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:12.250225 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-588a53ff-62c9-44b4-9055-2851e92dadf2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:12.258448 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-588a53ff-62c9-44b4-9055-2851e92dadf2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1267 microversion: 2.1 time: 0.160156 Apr 11 16:50:12.259038 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 537/1048] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:12 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:12.500411 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-351eadad-6d3d-4381-ae00-06aadb42e544 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:12.501099 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-351eadad-6d3d-4381-ae00-06aadb42e544 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:12.507926 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-351eadad-6d3d-4381-ae00-06aadb42e544 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:12.508366 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-351eadad-6d3d-4381-ae00-06aadb42e544 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:12.509125 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-351eadad-6d3d-4381-ae00-06aadb42e544 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:12.509549 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-351eadad-6d3d-4381-ae00-06aadb42e544 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:12.643949 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-351eadad-6d3d-4381-ae00-06aadb42e544 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:12.652038 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-351eadad-6d3d-4381-ae00-06aadb42e544 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5" status: 200 len: 1680 microversion: 2.1 time: 0.155447 Apr 11 16:50:12.652606 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 512/1049] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:12 2022] GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:13.284084 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-90d4b692-960e-41e2-8c8d-39a2a87109e4 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:13.284896 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-90d4b692-960e-41e2-8c8d-39a2a87109e4 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:13.292276 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-90d4b692-960e-41e2-8c8d-39a2a87109e4 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:13.292753 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-90d4b692-960e-41e2-8c8d-39a2a87109e4 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:13.293833 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-90d4b692-960e-41e2-8c8d-39a2a87109e4 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:13.294498 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-90d4b692-960e-41e2-8c8d-39a2a87109e4 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:13.432105 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-90d4b692-960e-41e2-8c8d-39a2a87109e4 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:13.440787 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-90d4b692-960e-41e2-8c8d-39a2a87109e4 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1453 microversion: 2.1 time: 0.162079 Apr 11 16:50:13.441380 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 538/1050] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:13 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:13.458280 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f18c2235-2ea8-42b4-bcf0-8673c631d5b1 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:13.458889 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f18c2235-2ea8-42b4-bcf0-8673c631d5b1 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:13.465168 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f18c2235-2ea8-42b4-bcf0-8673c631d5b1 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:13.465609 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f18c2235-2ea8-42b4-bcf0-8673c631d5b1 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:13.466364 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f18c2235-2ea8-42b4-bcf0-8673c631d5b1 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:13.466783 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f18c2235-2ea8-42b4-bcf0-8673c631d5b1 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:13.599992 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f18c2235-2ea8-42b4-bcf0-8673c631d5b1 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:13.608285 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f18c2235-2ea8-42b4-bcf0-8673c631d5b1 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1453 microversion: 2.1 time: 0.153940 Apr 11 16:50:13.608873 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 513/1051] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:13 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:13.670009 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ab377ef8-2ccb-4a88-80f5-bc3699957aae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:13.670611 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ab377ef8-2ccb-4a88-80f5-bc3699957aae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:13.676964 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ab377ef8-2ccb-4a88-80f5-bc3699957aae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:13.677417 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ab377ef8-2ccb-4a88-80f5-bc3699957aae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:13.678178 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ab377ef8-2ccb-4a88-80f5-bc3699957aae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:13.678600 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ab377ef8-2ccb-4a88-80f5-bc3699957aae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:13.843064 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ab377ef8-2ccb-4a88-80f5-bc3699957aae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:13.850622 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ab377ef8-2ccb-4a88-80f5-bc3699957aae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5" status: 200 len: 1680 microversion: 2.1 time: 0.184639 Apr 11 16:50:13.860904 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 539/1052] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:13 2022] GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5 => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:14.868939 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-9724690e-519d-4e9a-8391-825d817b0d16 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:14.869572 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-9724690e-519d-4e9a-8391-825d817b0d16 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:14.877134 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9724690e-519d-4e9a-8391-825d817b0d16 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:14.877571 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9724690e-519d-4e9a-8391-825d817b0d16 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:14.878355 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9724690e-519d-4e9a-8391-825d817b0d16 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:14.878782 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9724690e-519d-4e9a-8391-825d817b0d16 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:14.944021 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-9724690e-519d-4e9a-8391-825d817b0d16 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:14.952382 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-9724690e-519d-4e9a-8391-825d817b0d16 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5" status: 200 len: 1613 microversion: 2.1 time: 0.087396 Apr 11 16:50:14.953703 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 514/1053] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:14 2022] GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5 => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:15.168997 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-b59918c7-35c3-41dd-b918-acdbbeaf2f66 req-aed4fb33-be26-4675-82da-c24064a26345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ca07a6-3b06-4768-a6f8-0e88240dbad5", "name": "network-vif-deleted", "tag": "5219d559-b60a-4bdd-9b16-9096f03e133d"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:50:15.187610 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-b59918c7-35c3-41dd-b918-acdbbeaf2f66 req-aed4fb33-be26-4675-82da-c24064a26345 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:15.188271 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-b59918c7-35c3-41dd-b918-acdbbeaf2f66 req-aed4fb33-be26-4675-82da-c24064a26345 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:15.201971 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-b59918c7-35c3-41dd-b918-acdbbeaf2f66 req-aed4fb33-be26-4675-82da-c24064a26345 service nova] Creating event network-vif-deleted:5219d559-b60a-4bdd-9b16-9096f03e133d for instance 23ca07a6-3b06-4768-a6f8-0e88240dbad5 on hv-cinder-83716 Apr 11 16:50:15.208855 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-b59918c7-35c3-41dd-b918-acdbbeaf2f66 req-aed4fb33-be26-4675-82da-c24064a26345 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043791 Apr 11 16:50:15.209719 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 540/1054] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:50:15.971013 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d4f3c197-04d7-4230-8c88-9a4a97a14f77 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:15.971801 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d4f3c197-04d7-4230-8c88-9a4a97a14f77 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:15.978719 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d4f3c197-04d7-4230-8c88-9a4a97a14f77 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:15.979158 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d4f3c197-04d7-4230-8c88-9a4a97a14f77 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:15.980150 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d4f3c197-04d7-4230-8c88-9a4a97a14f77 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:15.980568 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d4f3c197-04d7-4230-8c88-9a4a97a14f77 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:15.996039 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-d4f3c197-04d7-4230-8c88-9a4a97a14f77 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] HTTP exception thrown: Instance 23ca07a6-3b06-4768-a6f8-0e88240dbad5 could not be found. Apr 11 16:50:15.996659 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d4f3c197-04d7-4230-8c88-9a4a97a14f77 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Returning 404 to user: Instance 23ca07a6-3b06-4768-a6f8-0e88240dbad5 could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:50:15.997620 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d4f3c197-04d7-4230-8c88-9a4a97a14f77 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5" status: 404 len: 111 microversion: 2.1 time: 0.030513 Apr 11 16:50:15.998193 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 515/1055] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:15 2022] GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:50:16.007617 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-6d0b987d-7014-42aa-9dba-01c98387f6f8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '.version_select at 0x7f741822d5e0>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:16.028159 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-6d0b987d-7014-42aa-9dba-01c98387f6f8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1206622482" status: 202 len: 0 microversion: 2.1 time: 0.024590 Apr 11 16:50:16.029314 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 541/1056] 10.222.0.65 () {58 vars in 1220 bytes} [Mon Apr 11 16:50:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1206622482 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 16:50:16.781982 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-765f0a31-c7ae-4d33-bcd1-a356b7747c22 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:16.782489 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-765f0a31-c7ae-4d33-bcd1-a356b7747c22 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:16.788612 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-765f0a31-c7ae-4d33-bcd1-a356b7747c22 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:16.789225 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-765f0a31-c7ae-4d33-bcd1-a356b7747c22 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:16.790114 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-765f0a31-c7ae-4d33-bcd1-a356b7747c22 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:16.790521 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-765f0a31-c7ae-4d33-bcd1-a356b7747c22 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:16.871277 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.objects.instance [None req-765f0a31-c7ae-4d33-bcd1-a356b7747c22 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lazy-loading 'services' on Instance uuid f8ba9b74-1ca3-4c03-b88e-c398753a5247 {{(pid=123774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:50:16.942327 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-765f0a31-c7ae-4d33-bcd1-a356b7747c22 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247/os-volume_attachments/97e33904-8fce-4ced-b352-03b32d6947c2" status: 202 len: 0 microversion: 2.1 time: 0.164216 Apr 11 16:50:16.942949 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 516/1057] 10.222.0.65 () {58 vars in 1415 bytes} [Mon Apr 11 16:50:16 2022] DELETE /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247/os-volume_attachments/97e33904-8fce-4ced-b352-03b32d6947c2 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 16:50:16.953629 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d2cea347-2bdf-4f35-ad3f-c8e0a70cac6c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:16.954886 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d2cea347-2bdf-4f35-ad3f-c8e0a70cac6c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:16.966357 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d2cea347-2bdf-4f35-ad3f-c8e0a70cac6c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:16.966986 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d2cea347-2bdf-4f35-ad3f-c8e0a70cac6c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:16.968075 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d2cea347-2bdf-4f35-ad3f-c8e0a70cac6c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:16.968616 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d2cea347-2bdf-4f35-ad3f-c8e0a70cac6c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:17.006242 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d2cea347-2bdf-4f35-ad3f-c8e0a70cac6c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058423 Apr 11 16:50:17.006832 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 542/1058] 10.222.0.65 () {58 vars in 1301 bytes} [Mon Apr 11 16:50:16 2022] GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:50:17.256110 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-58265fb6-be40-46e2-b93f-a7e1d9b8acf4 req-7936c047-192e-41f1-8783-ae16d55c57e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7c72056-5711-4122-8a5d-9f630cc79f32", "tag": "3a93865f-350d-4374-af08-1bab5e9726e5"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:50:17.265328 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-58265fb6-be40-46e2-b93f-a7e1d9b8acf4 req-7936c047-192e-41f1-8783-ae16d55c57e2 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:17.265764 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-58265fb6-be40-46e2-b93f-a7e1d9b8acf4 req-7936c047-192e-41f1-8783-ae16d55c57e2 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:17.278694 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-58265fb6-be40-46e2-b93f-a7e1d9b8acf4 req-7936c047-192e-41f1-8783-ae16d55c57e2 service nova] Creating event network-changed:3a93865f-350d-4374-af08-1bab5e9726e5 for instance c7c72056-5711-4122-8a5d-9f630cc79f32 on hv-cinder-83716 Apr 11 16:50:17.284249 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-58265fb6-be40-46e2-b93f-a7e1d9b8acf4 req-7936c047-192e-41f1-8783-ae16d55c57e2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032534 Apr 11 16:50:17.284872 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 517/1059] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:50:18.019054 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ef895ef0-b4e1-469b-9a29-904938a8cece tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:18.019997 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ef895ef0-b4e1-469b-9a29-904938a8cece tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:18.026462 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ef895ef0-b4e1-469b-9a29-904938a8cece tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:18.026881 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ef895ef0-b4e1-469b-9a29-904938a8cece tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:18.027665 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ef895ef0-b4e1-469b-9a29-904938a8cece tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:18.028187 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ef895ef0-b4e1-469b-9a29-904938a8cece tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:18.057412 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ef895ef0-b4e1-469b-9a29-904938a8cece tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042562 Apr 11 16:50:18.057980 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 543/1060] 10.222.0.65 () {58 vars in 1301 bytes} [Mon Apr 11 16:50:18 2022] GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 16:50:18.116963 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a1bc2f99-5c16-42b6-b91c-73f1cc523d77 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:18.117776 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a1bc2f99-5c16-42b6-b91c-73f1cc523d77 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:18.124671 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a1bc2f99-5c16-42b6-b91c-73f1cc523d77 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:18.125139 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a1bc2f99-5c16-42b6-b91c-73f1cc523d77 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:18.125956 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a1bc2f99-5c16-42b6-b91c-73f1cc523d77 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:18.126348 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a1bc2f99-5c16-42b6-b91c-73f1cc523d77 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:18.151347 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a1bc2f99-5c16-42b6-b91c-73f1cc523d77 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Going to try to terminate instance {{(pid=123774) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:50:18.234424 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a1bc2f99-5c16-42b6-b91c-73f1cc523d77 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247" status: 204 len: 0 microversion: 2.1 time: 0.121382 Apr 11 16:50:18.235500 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 518/1061] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:50:18 2022] DELETE /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:50:18.243899 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-0cc0fe57-0302-4d23-9b9e-2732b1f9e6fb tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:18.244491 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-0cc0fe57-0302-4d23-9b9e-2732b1f9e6fb tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:18.251389 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0cc0fe57-0302-4d23-9b9e-2732b1f9e6fb tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:18.251881 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0cc0fe57-0302-4d23-9b9e-2732b1f9e6fb tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:18.252657 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0cc0fe57-0302-4d23-9b9e-2732b1f9e6fb tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:18.253188 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0cc0fe57-0302-4d23-9b9e-2732b1f9e6fb tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:18.392833 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-0cc0fe57-0302-4d23-9b9e-2732b1f9e6fb tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:18.400854 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-0cc0fe57-0302-4d23-9b9e-2732b1f9e6fb tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247" status: 200 len: 1681 microversion: 2.1 time: 0.160946 Apr 11 16:50:18.401678 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 544/1062] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:18 2022] GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:19.419249 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c92914d5-1173-45b1-aed5-5063ce3666b3 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:19.419944 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c92914d5-1173-45b1-aed5-5063ce3666b3 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:19.426950 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c92914d5-1173-45b1-aed5-5063ce3666b3 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:19.427400 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c92914d5-1173-45b1-aed5-5063ce3666b3 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:19.428203 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c92914d5-1173-45b1-aed5-5063ce3666b3 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:19.428629 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c92914d5-1173-45b1-aed5-5063ce3666b3 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:19.621930 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-c92914d5-1173-45b1-aed5-5063ce3666b3 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:19.630476 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c92914d5-1173-45b1-aed5-5063ce3666b3 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247" status: 200 len: 1681 microversion: 2.1 time: 0.215489 Apr 11 16:50:19.631059 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 519/1063] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:19 2022] GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247 => generated 1681 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:20.649051 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-5c37cdad-40ca-402a-a1cf-3f2538d599b1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:20.649620 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-5c37cdad-40ca-402a-a1cf-3f2538d599b1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:20.656996 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5c37cdad-40ca-402a-a1cf-3f2538d599b1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:20.657445 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5c37cdad-40ca-402a-a1cf-3f2538d599b1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:20.658221 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5c37cdad-40ca-402a-a1cf-3f2538d599b1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:20.658652 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-5c37cdad-40ca-402a-a1cf-3f2538d599b1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:20.844328 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-5c37cdad-40ca-402a-a1cf-3f2538d599b1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:20.862022 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-5c37cdad-40ca-402a-a1cf-3f2538d599b1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247" status: 200 len: 1681 microversion: 2.1 time: 0.216949 Apr 11 16:50:20.862700 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 545/1064] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:20 2022] GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247 => generated 1681 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:21.138277 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-7f8a74ee-ef9b-45c0-9881-37f2be027e3f req-c2383efe-296f-43b9-b16e-dc23ce75d43f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ba9b74-1ca3-4c03-b88e-c398753a5247", "name": "network-vif-deleted", "tag": "57a7b058-1493-4381-8617-efe6e30e215c"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:50:21.146930 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-7f8a74ee-ef9b-45c0-9881-37f2be027e3f req-c2383efe-296f-43b9-b16e-dc23ce75d43f service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:21.147381 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-7f8a74ee-ef9b-45c0-9881-37f2be027e3f req-c2383efe-296f-43b9-b16e-dc23ce75d43f service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:21.159830 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-7f8a74ee-ef9b-45c0-9881-37f2be027e3f req-c2383efe-296f-43b9-b16e-dc23ce75d43f service nova] Creating event network-vif-deleted:57a7b058-1493-4381-8617-efe6e30e215c for instance f8ba9b74-1ca3-4c03-b88e-c398753a5247 on hv-cinder-83716 Apr 11 16:50:21.166340 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-7f8a74ee-ef9b-45c0-9881-37f2be027e3f req-c2383efe-296f-43b9-b16e-dc23ce75d43f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031601 Apr 11 16:50:21.167017 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 520/1065] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:50:21.880323 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-14278c9c-af67-4627-850e-694c60eac72d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:21.881103 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-14278c9c-af67-4627-850e-694c60eac72d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:21.889597 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-14278c9c-af67-4627-850e-694c60eac72d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:21.890389 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-14278c9c-af67-4627-850e-694c60eac72d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:21.891609 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-14278c9c-af67-4627-850e-694c60eac72d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:21.892415 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-14278c9c-af67-4627-850e-694c60eac72d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:21.909368 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-14278c9c-af67-4627-850e-694c60eac72d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] HTTP exception thrown: Instance f8ba9b74-1ca3-4c03-b88e-c398753a5247 could not be found. Apr 11 16:50:21.909970 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-14278c9c-af67-4627-850e-694c60eac72d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Returning 404 to user: Instance f8ba9b74-1ca3-4c03-b88e-c398753a5247 could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:50:21.910819 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-14278c9c-af67-4627-850e-694c60eac72d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247" status: 404 len: 111 microversion: 2.1 time: 0.034672 Apr 11 16:50:21.911398 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 546/1066] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:21 2022] GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:50:21.922549 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-4b9739a7-c719-4eca-8245-768bafc217df tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '.version_select at 0x7f74181cf0d0>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:21.943249 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-4b9739a7-c719-4eca-8245-768bafc217df tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-458417523" status: 202 len: 0 microversion: 2.1 time: 0.026528 Apr 11 16:50:21.944024 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 521/1067] 10.222.0.65 () {58 vars in 1217 bytes} [Mon Apr 11 16:50:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-458417523 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:50:22.600494 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-aad27e0a-9435-4cdb-b56c-5850f1ed3801 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Action: 'create', calling method: .version_select at 0x7f741c097040>, body: {"keypair": {"name": "tempest-keypair-863310420"}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:50:22.616193 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-aad27e0a-9435-4cdb-b56c-5850f1ed3801 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:50:22.620066 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-aad27e0a-9435-4cdb-b56c-5850f1ed3801 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for user 089723b908ba4a25bb83de445b69561d and project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:50:22.765327 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-aad27e0a-9435-4cdb-b56c-5850f1ed3801 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:50:22.769093 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-aad27e0a-9435-4cdb-b56c-5850f1ed3801 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for user 089723b908ba4a25bb83de445b69561d and project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:50:22.783836 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-aad27e0a-9435-4cdb-b56c-5850f1ed3801 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.187336 Apr 11 16:50:22.784448 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 547/1068] 10.222.0.65 () {60 vars in 1157 bytes} [Mon Apr 11 16:50:22 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:24.420779 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-61190397-36c7-4ce9-bc18-a8e223f7235c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-612064353", "imageRef": "e989c938-7b7a-445c-aec9-596e81d35104", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64f8adf0-5b62-426a-b30a-0690e612962b"}], "security_groups": [{"name": "tempest-securitygroup--929800538"}], "key_name": "tempest-keypair-863310420", "user_data": "}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:50:24.530849 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.network.neutron [None req-61190397-36c7-4ce9-bc18-a8e223f7235c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] validate_networks() for [('64f8adf0-5b62-426a-b30a-0690e612962b', None, None, None, None, None)] {{(pid=123774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:50:24.911912 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-61190397-36c7-4ce9-bc18-a8e223f7235c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Flavor limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:50:24.912333 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-61190397-36c7-4ce9-bc18-a8e223f7235c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Image limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:50:24.912804 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-61190397-36c7-4ce9-bc18-a8e223f7235c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Flavor pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:50:24.913207 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-61190397-36c7-4ce9-bc18-a8e223f7235c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Image pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:50:24.913635 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-61190397-36c7-4ce9-bc18-a8e223f7235c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:50:24.923582 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-61190397-36c7-4ce9-bc18-a8e223f7235c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:24.924057 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-61190397-36c7-4ce9-bc18-a8e223f7235c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:24.924872 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-61190397-36c7-4ce9-bc18-a8e223f7235c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:24.925304 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-61190397-36c7-4ce9-bc18-a8e223f7235c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:24.942367 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-61190397-36c7-4ce9-bc18-a8e223f7235c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:50:24.946378 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-61190397-36c7-4ce9-bc18-a8e223f7235c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for user 089723b908ba4a25bb83de445b69561d and project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:50:24.958702 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-61190397-36c7-4ce9-bc18-a8e223f7235c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Going to run 1 instances... {{(pid=123774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:50:24.961153 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-61190397-36c7-4ce9-bc18-a8e223f7235c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e989c938-7b7a-445c-aec9-596e81d35104',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:50:25.010181 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-61190397-36c7-4ce9-bc18-a8e223f7235c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.593724 Apr 11 16:50:25.011009 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 522/1069] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Apr 11 16:50:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 16:50:25.022072 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-cb1afbf3-eb42-4509-a52e-faa635ad7801 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:25.022704 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-cb1afbf3-eb42-4509-a52e-faa635ad7801 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:25.082564 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-cb1afbf3-eb42-4509-a52e-faa635ad7801 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:25.090515 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-cb1afbf3-eb42-4509-a52e-faa635ad7801 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547" status: 200 len: 1240 microversion: 2.1 time: 0.072917 Apr 11 16:50:25.091109 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 548/1070] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:25 2022] GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547 => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:26.108620 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ea986a90-2213-4854-842a-ba724a6f3710 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:26.109195 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ea986a90-2213-4854-842a-ba724a6f3710 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:26.116905 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ea986a90-2213-4854-842a-ba724a6f3710 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:26.117339 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ea986a90-2213-4854-842a-ba724a6f3710 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:26.118100 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ea986a90-2213-4854-842a-ba724a6f3710 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:26.118520 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ea986a90-2213-4854-842a-ba724a6f3710 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:26.190122 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ea986a90-2213-4854-842a-ba724a6f3710 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:26.200357 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ea986a90-2213-4854-842a-ba724a6f3710 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547" status: 200 len: 1300 microversion: 2.1 time: 0.096148 Apr 11 16:50:26.211943 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 523/1071] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:26 2022] GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547 => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:27.218999 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-7977d423-e61d-48a2-9d92-673f76d89198 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:27.219743 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-7977d423-e61d-48a2-9d92-673f76d89198 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:27.227518 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7977d423-e61d-48a2-9d92-673f76d89198 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:27.228686 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7977d423-e61d-48a2-9d92-673f76d89198 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:27.229848 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7977d423-e61d-48a2-9d92-673f76d89198 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:27.230547 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7977d423-e61d-48a2-9d92-673f76d89198 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:27.372975 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-7977d423-e61d-48a2-9d92-673f76d89198 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:27.381177 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-7977d423-e61d-48a2-9d92-673f76d89198 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547" status: 200 len: 1365 microversion: 2.1 time: 0.166655 Apr 11 16:50:27.381893 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 549/1072] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:27 2022] GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:27.816335 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-6e5b23e1-0a19-47bd-8f77-2135ba13d88a req-7aab4448-836f-4e29-a2db-57895f8e0003 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cd59e94-4a47-4bee-8fa2-ff2540b37547", "tag": "ed000f62-7c20-4cbb-86b6-a2ea779e28b3"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:50:27.825981 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-6e5b23e1-0a19-47bd-8f77-2135ba13d88a req-7aab4448-836f-4e29-a2db-57895f8e0003 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:27.826745 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-6e5b23e1-0a19-47bd-8f77-2135ba13d88a req-7aab4448-836f-4e29-a2db-57895f8e0003 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:27.846288 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-6e5b23e1-0a19-47bd-8f77-2135ba13d88a req-7aab4448-836f-4e29-a2db-57895f8e0003 service nova] Creating event network-changed:ed000f62-7c20-4cbb-86b6-a2ea779e28b3 for instance 2cd59e94-4a47-4bee-8fa2-ff2540b37547 on hv-cinder-83716 Apr 11 16:50:27.853782 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-6e5b23e1-0a19-47bd-8f77-2135ba13d88a req-7aab4448-836f-4e29-a2db-57895f8e0003 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042308 Apr 11 16:50:27.856598 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 524/1073] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:50:28.398877 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f6e776e2-fd87-4c46-b24e-2b1dd0280246 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:28.399475 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f6e776e2-fd87-4c46-b24e-2b1dd0280246 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:28.406990 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f6e776e2-fd87-4c46-b24e-2b1dd0280246 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:28.407349 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f6e776e2-fd87-4c46-b24e-2b1dd0280246 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:28.408192 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f6e776e2-fd87-4c46-b24e-2b1dd0280246 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:28.408623 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f6e776e2-fd87-4c46-b24e-2b1dd0280246 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:28.544735 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-f6e776e2-fd87-4c46-b24e-2b1dd0280246 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:28.552774 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f6e776e2-fd87-4c46-b24e-2b1dd0280246 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547" status: 200 len: 1365 microversion: 2.1 time: 0.157885 Apr 11 16:50:28.553361 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 550/1074] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:28 2022] GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:29.571064 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-8b7e50e3-25c0-4773-b854-bfd8cd5f81a8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:29.571752 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-8b7e50e3-25c0-4773-b854-bfd8cd5f81a8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:29.579118 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8b7e50e3-25c0-4773-b854-bfd8cd5f81a8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:29.579559 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8b7e50e3-25c0-4773-b854-bfd8cd5f81a8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:29.580372 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8b7e50e3-25c0-4773-b854-bfd8cd5f81a8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:29.580801 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-8b7e50e3-25c0-4773-b854-bfd8cd5f81a8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:29.718636 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8b7e50e3-25c0-4773-b854-bfd8cd5f81a8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:29.726333 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-8b7e50e3-25c0-4773-b854-bfd8cd5f81a8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547" status: 200 len: 1365 microversion: 2.1 time: 0.159698 Apr 11 16:50:29.726952 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 525/1075] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:29 2022] GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:30.744253 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-42d3922e-7fb6-4acf-915e-b6da7dc50c17 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:30.744930 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-42d3922e-7fb6-4acf-915e-b6da7dc50c17 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:30.752180 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-42d3922e-7fb6-4acf-915e-b6da7dc50c17 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:30.752632 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-42d3922e-7fb6-4acf-915e-b6da7dc50c17 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:30.753417 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-42d3922e-7fb6-4acf-915e-b6da7dc50c17 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:30.753851 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-42d3922e-7fb6-4acf-915e-b6da7dc50c17 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:30.884093 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-42d3922e-7fb6-4acf-915e-b6da7dc50c17 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:30.891553 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-42d3922e-7fb6-4acf-915e-b6da7dc50c17 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547" status: 200 len: 1365 microversion: 2.1 time: 0.151288 Apr 11 16:50:30.892176 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 551/1076] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:30 2022] GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:31.909137 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-aa1221a8-e784-4f1e-ac78-68af2c15b0ca tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:31.909729 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-aa1221a8-e784-4f1e-ac78-68af2c15b0ca tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:31.916348 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-aa1221a8-e784-4f1e-ac78-68af2c15b0ca tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:31.916861 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-aa1221a8-e784-4f1e-ac78-68af2c15b0ca tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:31.918038 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-aa1221a8-e784-4f1e-ac78-68af2c15b0ca tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:31.918476 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-aa1221a8-e784-4f1e-ac78-68af2c15b0ca tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:32.057570 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-aa1221a8-e784-4f1e-ac78-68af2c15b0ca tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:32.065623 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-aa1221a8-e784-4f1e-ac78-68af2c15b0ca tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547" status: 200 len: 1365 microversion: 2.1 time: 0.160601 Apr 11 16:50:32.066201 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 526/1077] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:31 2022] GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:33.082646 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-75bf8e87-6f72-472b-b7f5-45583a2ef4e1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:33.083292 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-75bf8e87-6f72-472b-b7f5-45583a2ef4e1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:33.090185 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-75bf8e87-6f72-472b-b7f5-45583a2ef4e1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:33.090667 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-75bf8e87-6f72-472b-b7f5-45583a2ef4e1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:33.091460 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-75bf8e87-6f72-472b-b7f5-45583a2ef4e1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:33.091932 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-75bf8e87-6f72-472b-b7f5-45583a2ef4e1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:33.229035 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-75bf8e87-6f72-472b-b7f5-45583a2ef4e1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:33.237458 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-75bf8e87-6f72-472b-b7f5-45583a2ef4e1 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547" status: 200 len: 1365 microversion: 2.1 time: 0.158682 Apr 11 16:50:33.238050 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 552/1078] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:33 2022] GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:33.369580 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-f88a8fa6-7719-4175-9358-451ad081b097 req-f5ed9de3-a3e2-4099-af65-03255c4f50cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cd59e94-4a47-4bee-8fa2-ff2540b37547", "name": "network-vif-plugged", "status": "completed", "tag": "ed000f62-7c20-4cbb-86b6-a2ea779e28b3"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:50:33.382222 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-f88a8fa6-7719-4175-9358-451ad081b097 req-f5ed9de3-a3e2-4099-af65-03255c4f50cd service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:33.382669 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-f88a8fa6-7719-4175-9358-451ad081b097 req-f5ed9de3-a3e2-4099-af65-03255c4f50cd service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:33.396038 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-f88a8fa6-7719-4175-9358-451ad081b097 req-f5ed9de3-a3e2-4099-af65-03255c4f50cd service nova] Creating event network-vif-plugged:ed000f62-7c20-4cbb-86b6-a2ea779e28b3 for instance 2cd59e94-4a47-4bee-8fa2-ff2540b37547 on hv-cinder-83716 Apr 11 16:50:33.401570 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-f88a8fa6-7719-4175-9358-451ad081b097 req-f5ed9de3-a3e2-4099-af65-03255c4f50cd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038461 Apr 11 16:50:33.402367 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 527/1079] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:50:34.254843 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-918d6df2-a794-466e-ae99-01b8800207cf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:34.255435 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-918d6df2-a794-466e-ae99-01b8800207cf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:34.262611 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-918d6df2-a794-466e-ae99-01b8800207cf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:34.263064 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-918d6df2-a794-466e-ae99-01b8800207cf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:34.263911 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-918d6df2-a794-466e-ae99-01b8800207cf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:34.264346 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-918d6df2-a794-466e-ae99-01b8800207cf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:34.407475 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-918d6df2-a794-466e-ae99-01b8800207cf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:34.415655 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-918d6df2-a794-466e-ae99-01b8800207cf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547" status: 200 len: 1365 microversion: 2.1 time: 0.164821 Apr 11 16:50:34.416237 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 553/1080] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:34 2022] GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:35.434348 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-459515a6-2f2e-4f40-8677-cbd5c81f2788 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:35.435223 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-459515a6-2f2e-4f40-8677-cbd5c81f2788 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:35.441985 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-459515a6-2f2e-4f40-8677-cbd5c81f2788 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:35.442431 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-459515a6-2f2e-4f40-8677-cbd5c81f2788 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:35.443210 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-459515a6-2f2e-4f40-8677-cbd5c81f2788 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:35.443649 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-459515a6-2f2e-4f40-8677-cbd5c81f2788 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:35.578190 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-459515a6-2f2e-4f40-8677-cbd5c81f2788 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:50:35.586011 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-459515a6-2f2e-4f40-8677-cbd5c81f2788 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547" status: 200 len: 1555 microversion: 2.1 time: 0.156420 Apr 11 16:50:35.586581 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 528/1081] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:50:35 2022] GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:50:35.605455 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d302df43-3dfb-4928-b01a-5fa67615ab34 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:50:35.606179 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d302df43-3dfb-4928-b01a-5fa67615ab34 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:50:35.615965 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d302df43-3dfb-4928-b01a-5fa67615ab34 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:35.616494 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d302df43-3dfb-4928-b01a-5fa67615ab34 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:35.617581 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d302df43-3dfb-4928-b01a-5fa67615ab34 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:35.618181 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d302df43-3dfb-4928-b01a-5fa67615ab34 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:35.704833 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d302df43-3dfb-4928-b01a-5fa67615ab34 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105756 Apr 11 16:50:35.705534 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 554/1082] 10.222.0.65 () {58 vars in 1274 bytes} [Mon Apr 11 16:50:35 2022] GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:50:37.000510 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-4ee1cd48-636e-4faf-9c74-8ea7133641ee req-4e6f1b31-0eec-4114-9a75-4be1b2df657c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cd59e94-4a47-4bee-8fa2-ff2540b37547", "tag": "ed000f62-7c20-4cbb-86b6-a2ea779e28b3"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:50:37.009900 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-4ee1cd48-636e-4faf-9c74-8ea7133641ee req-4e6f1b31-0eec-4114-9a75-4be1b2df657c service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:50:37.010469 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-4ee1cd48-636e-4faf-9c74-8ea7133641ee req-4e6f1b31-0eec-4114-9a75-4be1b2df657c service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:50:37.022437 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-4ee1cd48-636e-4faf-9c74-8ea7133641ee req-4e6f1b31-0eec-4114-9a75-4be1b2df657c service nova] Creating event network-changed:ed000f62-7c20-4cbb-86b6-a2ea779e28b3 for instance 2cd59e94-4a47-4bee-8fa2-ff2540b37547 on hv-cinder-83716 Apr 11 16:50:37.027935 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-4ee1cd48-636e-4faf-9c74-8ea7133641ee req-4e6f1b31-0eec-4114-9a75-4be1b2df657c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031124 Apr 11 16:50:37.031077 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 529/1083] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:51:57.081102 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: ERROR oslo.messaging._drivers.impl_rabbit [-] [11f07383-0727-4fdf-963c-5f4708c127cd] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 16:51:57.156683 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ca520e46-aea9-42ac-a664-7e963677ef3b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:51:57.157207 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ca520e46-aea9-42ac-a664-7e963677ef3b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:51:57.164237 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ca520e46-aea9-42ac-a664-7e963677ef3b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:51:57.164680 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ca520e46-aea9-42ac-a664-7e963677ef3b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:51:57.165435 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ca520e46-aea9-42ac-a664-7e963677ef3b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:51:57.165851 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ca520e46-aea9-42ac-a664-7e963677ef3b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:51:57.190196 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ca520e46-aea9-42ac-a664-7e963677ef3b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547/ips" status: 200 len: 150 microversion: 2.1 time: 0.110844 Apr 11 16:51:57.190808 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 555/1084] 10.222.0.65 () {58 vars in 1247 bytes} [Mon Apr 11 16:51:57 2022] GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547/ips => generated 150 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:51:58.532597 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b2ed7652-0b57-406e-9e17-6d1ba8e58f14] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 16:51:58.537090 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-07361bcc-7239-40f7-8e79-48f8087532dd tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d95d0a3-c8d1-48a8-ab34-32eb86eec7ec"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:51:58.538403 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-07361bcc-7239-40f7-8e79-48f8087532dd tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:51:58.545091 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-07361bcc-7239-40f7-8e79-48f8087532dd tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:51:58.545536 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-07361bcc-7239-40f7-8e79-48f8087532dd tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:51:58.546308 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-07361bcc-7239-40f7-8e79-48f8087532dd tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:51:58.546737 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-07361bcc-7239-40f7-8e79-48f8087532dd tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:51:59.542688 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO oslo.messaging._drivers.impl_rabbit [-] [b2ed7652-0b57-406e-9e17-6d1ba8e58f14] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 37106. Apr 11 16:51:59.678272 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-07361bcc-7239-40f7-8e79-48f8087532dd tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "POST /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.146966 Apr 11 16:51:59.679699 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 530/1085] 10.222.0.65 () {60 vars in 1322 bytes} [Mon Apr 11 16:51:58 2022] POST /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547/os-volume_attachments => generated 194 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:52:06.226160 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b0411345-17cd-4ae7-aa4e-281ee015bc4c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:06.226743 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-818f5213-2efb-4200-b931-17a888efcf3b req-be9fd0bf-e4db-4299-bb0a-8a209e0e4a31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7c72056-5711-4122-8a5d-9f630cc79f32", "tag": "3a93865f-350d-4374-af08-1bab5e9726e5"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:52:06.227118 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b0411345-17cd-4ae7-aa4e-281ee015bc4c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:06.234865 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b0411345-17cd-4ae7-aa4e-281ee015bc4c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:06.235318 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b0411345-17cd-4ae7-aa4e-281ee015bc4c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:06.235896 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-818f5213-2efb-4200-b931-17a888efcf3b req-be9fd0bf-e4db-4299-bb0a-8a209e0e4a31 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:06.236119 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b0411345-17cd-4ae7-aa4e-281ee015bc4c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:06.236311 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-818f5213-2efb-4200-b931-17a888efcf3b req-be9fd0bf-e4db-4299-bb0a-8a209e0e4a31 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:06.236551 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b0411345-17cd-4ae7-aa4e-281ee015bc4c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:06.249647 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-818f5213-2efb-4200-b931-17a888efcf3b req-be9fd0bf-e4db-4299-bb0a-8a209e0e4a31 service nova] Creating event network-changed:3a93865f-350d-4374-af08-1bab5e9726e5 for instance c7c72056-5711-4122-8a5d-9f630cc79f32 on hv-cinder-83716 Apr 11 16:52:06.261922 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-818f5213-2efb-4200-b931-17a888efcf3b req-be9fd0bf-e4db-4299-bb0a-8a209e0e4a31 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038479 Apr 11 16:52:06.262973 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 531/1086] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:52:06.263457 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO oslo.messaging._drivers.impl_rabbit [-] [11f07383-0727-4fdf-963c-5f4708c127cd] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 37132. Apr 11 16:52:06.275007 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b0411345-17cd-4ae7-aa4e-281ee015bc4c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Going to try to terminate instance {{(pid=123773) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:52:06.378529 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b0411345-17cd-4ae7-aa4e-281ee015bc4c tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 204 len: 0 microversion: 2.1 time: 0.156593 Apr 11 16:52:06.385485 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 556/1087] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:52:06 2022] DELETE /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:52:06.395991 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d87f32c6-4c69-4aa4-87d3-466ce40d8376 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:06.396969 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d87f32c6-4c69-4aa4-87d3-466ce40d8376 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:06.404496 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d87f32c6-4c69-4aa4-87d3-466ce40d8376 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:06.404955 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d87f32c6-4c69-4aa4-87d3-466ce40d8376 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:06.405802 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d87f32c6-4c69-4aa4-87d3-466ce40d8376 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:06.406236 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d87f32c6-4c69-4aa4-87d3-466ce40d8376 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:06.823418 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d87f32c6-4c69-4aa4-87d3-466ce40d8376 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:06.830931 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d87f32c6-4c69-4aa4-87d3-466ce40d8376 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1578 microversion: 2.1 time: 0.439190 Apr 11 16:52:06.831409 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 532/1088] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:06 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1578 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:07.212259 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f825a876-4384-4061-a1d6-29c5523d4f08 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d95d0a3-c8d1-48a8-ab34-32eb86eec7ec"}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:52:07.214229 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f825a876-4384-4061-a1d6-29c5523d4f08 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:07.220748 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f825a876-4384-4061-a1d6-29c5523d4f08 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:07.221188 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f825a876-4384-4061-a1d6-29c5523d4f08 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:07.222037 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f825a876-4384-4061-a1d6-29c5523d4f08 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:07.222377 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f825a876-4384-4061-a1d6-29c5523d4f08 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:07.315798 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-f825a876-4384-4061-a1d6-29c5523d4f08 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] HTTP exception thrown: Invalid volume: volume 2d95d0a3-c8d1-48a8-ab34-32eb86eec7ec is already attached to instances: 2cd59e94-4a47-4bee-8fa2-ff2540b37547 Apr 11 16:52:07.316281 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f825a876-4384-4061-a1d6-29c5523d4f08 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Returning 400 to user: Invalid volume: volume 2d95d0a3-c8d1-48a8-ab34-32eb86eec7ec is already attached to instances: 2cd59e94-4a47-4bee-8fa2-ff2540b37547 {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:52:07.316896 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f825a876-4384-4061-a1d6-29c5523d4f08 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "POST /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109234 Apr 11 16:52:07.317473 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 557/1089] 10.222.0.65 () {60 vars in 1322 bytes} [Mon Apr 11 16:52:07 2022] POST /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 16:52:07.384210 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-61877113-1b13-4058-9f2e-9786af81d0ef tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:07.384696 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-61877113-1b13-4058-9f2e-9786af81d0ef tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:07.392190 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-61877113-1b13-4058-9f2e-9786af81d0ef tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:07.392638 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-61877113-1b13-4058-9f2e-9786af81d0ef tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:07.393454 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-61877113-1b13-4058-9f2e-9786af81d0ef tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:07.394090 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-61877113-1b13-4058-9f2e-9786af81d0ef tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:07.479372 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.objects.instance [None req-61877113-1b13-4058-9f2e-9786af81d0ef tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lazy-loading 'services' on Instance uuid 2cd59e94-4a47-4bee-8fa2-ff2540b37547 {{(pid=123774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:52:07.554833 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-61877113-1b13-4058-9f2e-9786af81d0ef tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547/os-volume_attachments/2d95d0a3-c8d1-48a8-ab34-32eb86eec7ec" status: 202 len: 0 microversion: 2.1 time: 0.174962 Apr 11 16:52:07.555429 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 533/1090] 10.222.0.65 () {58 vars in 1415 bytes} [Mon Apr 11 16:52:07 2022] DELETE /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547/os-volume_attachments/2d95d0a3-c8d1-48a8-ab34-32eb86eec7ec => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:52:07.568492 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3cd05164-d9f2-45c6-8b0f-359ef7ea2a3a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:07.570226 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3cd05164-d9f2-45c6-8b0f-359ef7ea2a3a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:07.581608 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3cd05164-d9f2-45c6-8b0f-359ef7ea2a3a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:07.582051 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3cd05164-d9f2-45c6-8b0f-359ef7ea2a3a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:07.583030 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3cd05164-d9f2-45c6-8b0f-359ef7ea2a3a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:07.583455 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3cd05164-d9f2-45c6-8b0f-359ef7ea2a3a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:07.614680 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3cd05164-d9f2-45c6-8b0f-359ef7ea2a3a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052911 Apr 11 16:52:07.615168 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 558/1091] 10.222.0.65 () {58 vars in 1301 bytes} [Mon Apr 11 16:52:07 2022] GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:52:07.850313 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5629d2be-3b68-4b7b-a4f7-3051c27dff6d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:07.851076 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5629d2be-3b68-4b7b-a4f7-3051c27dff6d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:07.858381 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5629d2be-3b68-4b7b-a4f7-3051c27dff6d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:07.859437 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5629d2be-3b68-4b7b-a4f7-3051c27dff6d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:07.860251 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5629d2be-3b68-4b7b-a4f7-3051c27dff6d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:07.860676 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5629d2be-3b68-4b7b-a4f7-3051c27dff6d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:08.008994 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5629d2be-3b68-4b7b-a4f7-3051c27dff6d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:08.016918 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5629d2be-3b68-4b7b-a4f7-3051c27dff6d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1578 microversion: 2.1 time: 0.170841 Apr 11 16:52:08.017502 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 534/1092] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:07 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:08.627241 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f4eea55c-734b-4070-8d16-5b8d24f72a42 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:08.628108 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f4eea55c-734b-4070-8d16-5b8d24f72a42 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:08.635245 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f4eea55c-734b-4070-8d16-5b8d24f72a42 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:08.636108 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f4eea55c-734b-4070-8d16-5b8d24f72a42 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:08.637040 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f4eea55c-734b-4070-8d16-5b8d24f72a42 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:08.637472 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f4eea55c-734b-4070-8d16-5b8d24f72a42 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:08.666878 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f4eea55c-734b-4070-8d16-5b8d24f72a42 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043537 Apr 11 16:52:08.667788 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 559/1093] 10.222.0.65 () {58 vars in 1301 bytes} [Mon Apr 11 16:52:08 2022] GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 11 16:52:08.733958 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-12e1827b-7a91-43bc-8bb0-9fd354dd6ed4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:08.734427 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-12e1827b-7a91-43bc-8bb0-9fd354dd6ed4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:08.741029 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-12e1827b-7a91-43bc-8bb0-9fd354dd6ed4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:08.741450 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-12e1827b-7a91-43bc-8bb0-9fd354dd6ed4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:08.742573 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-12e1827b-7a91-43bc-8bb0-9fd354dd6ed4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:08.742998 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-12e1827b-7a91-43bc-8bb0-9fd354dd6ed4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:08.744079 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-177b9abc-6164-41ac-bde7-b7e38a6ad41e req-bcd9a6c5-81d7-4e0b-af59-6e438b7edac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7c72056-5711-4122-8a5d-9f630cc79f32", "name": "network-vif-deleted", "tag": "3a93865f-350d-4374-af08-1bab5e9726e5"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:52:08.752348 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-177b9abc-6164-41ac-bde7-b7e38a6ad41e req-bcd9a6c5-81d7-4e0b-af59-6e438b7edac2 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:08.752787 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-177b9abc-6164-41ac-bde7-b7e38a6ad41e req-bcd9a6c5-81d7-4e0b-af59-6e438b7edac2 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:08.765873 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-177b9abc-6164-41ac-bde7-b7e38a6ad41e req-bcd9a6c5-81d7-4e0b-af59-6e438b7edac2 service nova] Creating event network-vif-deleted:3a93865f-350d-4374-af08-1bab5e9726e5 for instance c7c72056-5711-4122-8a5d-9f630cc79f32 on hv-cinder-83716 Apr 11 16:52:08.770467 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-12e1827b-7a91-43bc-8bb0-9fd354dd6ed4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Going to try to terminate instance {{(pid=123774) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:52:08.771870 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-177b9abc-6164-41ac-bde7-b7e38a6ad41e req-bcd9a6c5-81d7-4e0b-af59-6e438b7edac2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031434 Apr 11 16:52:08.772726 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 560/1094] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 16:52:08.852853 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-12e1827b-7a91-43bc-8bb0-9fd354dd6ed4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547" status: 204 len: 0 microversion: 2.1 time: 0.123216 Apr 11 16:52:08.853444 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 535/1095] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:52:08 2022] DELETE /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:52:08.862756 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-accdf851-662b-4be4-935a-0158ed1ed705 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:08.863474 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-accdf851-662b-4be4-935a-0158ed1ed705 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:08.869683 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-accdf851-662b-4be4-935a-0158ed1ed705 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:08.870264 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-accdf851-662b-4be4-935a-0158ed1ed705 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:08.871253 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-accdf851-662b-4be4-935a-0158ed1ed705 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:08.871806 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-accdf851-662b-4be4-935a-0158ed1ed705 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:09.015695 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-accdf851-662b-4be4-935a-0158ed1ed705 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:09.024444 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-accdf851-662b-4be4-935a-0158ed1ed705 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547" status: 200 len: 1680 microversion: 2.1 time: 0.165965 Apr 11 16:52:09.034531 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 561/1096] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:08 2022] GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:09.035550 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-255f8cac-9b8c-4d32-9b31-ab6910f340a2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:09.036139 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-255f8cac-9b8c-4d32-9b31-ab6910f340a2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:09.043004 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-255f8cac-9b8c-4d32-9b31-ab6910f340a2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:09.043468 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-255f8cac-9b8c-4d32-9b31-ab6910f340a2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:09.044279 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-255f8cac-9b8c-4d32-9b31-ab6910f340a2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:09.044701 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-255f8cac-9b8c-4d32-9b31-ab6910f340a2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:09.109690 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-255f8cac-9b8c-4d32-9b31-ab6910f340a2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:09.117702 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-255f8cac-9b8c-4d32-9b31-ab6910f340a2 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1226 microversion: 2.1 time: 0.086656 Apr 11 16:52:09.118313 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 536/1097] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:09 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:10.042998 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-61b885e2-7aa2-4dc2-99e1-1df4cfefaa96 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:10.043626 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-61b885e2-7aa2-4dc2-99e1-1df4cfefaa96 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:10.050693 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-61b885e2-7aa2-4dc2-99e1-1df4cfefaa96 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:10.051135 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-61b885e2-7aa2-4dc2-99e1-1df4cfefaa96 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:10.051925 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-61b885e2-7aa2-4dc2-99e1-1df4cfefaa96 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:10.052351 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-61b885e2-7aa2-4dc2-99e1-1df4cfefaa96 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:10.135936 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f2d46c66-55f8-4151-a8e2-667ac743421b tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:10.136813 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f2d46c66-55f8-4151-a8e2-667ac743421b tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:10.144140 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f2d46c66-55f8-4151-a8e2-667ac743421b tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:10.144581 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f2d46c66-55f8-4151-a8e2-667ac743421b tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:10.145332 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f2d46c66-55f8-4151-a8e2-667ac743421b tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:10.145792 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f2d46c66-55f8-4151-a8e2-667ac743421b tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:10.177002 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f2d46c66-55f8-4151-a8e2-667ac743421b tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:10.177445 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f2d46c66-55f8-4151-a8e2-667ac743421b tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:10.177892 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.objects.instance [None req-f2d46c66-55f8-4151-a8e2-667ac743421b tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lazy-loading 'fault' on Instance uuid c7c72056-5711-4122-8a5d-9f630cc79f32 {{(pid=123774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:52:10.186065 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-61b885e2-7aa2-4dc2-99e1-1df4cfefaa96 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:10.193689 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-61b885e2-7aa2-4dc2-99e1-1df4cfefaa96 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547" status: 200 len: 1680 microversion: 2.1 time: 0.155272 Apr 11 16:52:10.194278 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 562/1098] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:10 2022] GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:10.226561 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-f2d46c66-55f8-4151-a8e2-667ac743421b tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:10.236589 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f2d46c66-55f8-4151-a8e2-667ac743421b tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 200 len: 1231 microversion: 2.1 time: 0.105765 Apr 11 16:52:10.237594 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 537/1099] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:10 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 1231 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:11.211084 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-dac093ee-28e4-4919-a88c-26e3467f86a6 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:11.211858 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-dac093ee-28e4-4919-a88c-26e3467f86a6 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:11.219164 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dac093ee-28e4-4919-a88c-26e3467f86a6 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:11.219711 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dac093ee-28e4-4919-a88c-26e3467f86a6 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:11.220599 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dac093ee-28e4-4919-a88c-26e3467f86a6 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:11.221097 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dac093ee-28e4-4919-a88c-26e3467f86a6 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:11.260459 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5820e4e4-00cf-4ec7-b932-3bd3dd8b3d04 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:11.262004 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5820e4e4-00cf-4ec7-b932-3bd3dd8b3d04 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: c7c72056-5711-4122-8a5d-9f630cc79f32] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:11.273862 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5820e4e4-00cf-4ec7-b932-3bd3dd8b3d04 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:11.274698 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5820e4e4-00cf-4ec7-b932-3bd3dd8b3d04 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:11.276175 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5820e4e4-00cf-4ec7-b932-3bd3dd8b3d04 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:11.282629 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5820e4e4-00cf-4ec7-b932-3bd3dd8b3d04 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:11.301711 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-dac093ee-28e4-4919-a88c-26e3467f86a6 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:11.306109 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-5820e4e4-00cf-4ec7-b932-3bd3dd8b3d04 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] HTTP exception thrown: Instance c7c72056-5711-4122-8a5d-9f630cc79f32 could not be found. Apr 11 16:52:11.306957 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5820e4e4-00cf-4ec7-b932-3bd3dd8b3d04 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Returning 404 to user: Instance c7c72056-5711-4122-8a5d-9f630cc79f32 could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:52:11.307909 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5820e4e4-00cf-4ec7-b932-3bd3dd8b3d04 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32" status: 404 len: 111 microversion: 2.1 time: 0.054928 Apr 11 16:52:11.308498 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 538/1100] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:11 2022] GET /compute/v2.1/servers/c7c72056-5711-4122-8a5d-9f630cc79f32 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 16:52:11.311505 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-dac093ee-28e4-4919-a88c-26e3467f86a6 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547" status: 200 len: 1613 microversion: 2.1 time: 0.104580 Apr 11 16:52:11.312113 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 563/1101] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:11 2022] GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547 => generated 1613 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:11.496676 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-71c02215-a8b1-403a-9fd0-1b7016a62245 req-a7b287df-c231-482d-91dc-98b9bede58cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cd59e94-4a47-4bee-8fa2-ff2540b37547", "name": "network-vif-deleted", "tag": "ed000f62-7c20-4cbb-86b6-a2ea779e28b3"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:52:11.507452 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-71c02215-a8b1-403a-9fd0-1b7016a62245 req-a7b287df-c231-482d-91dc-98b9bede58cd service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:11.508048 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-71c02215-a8b1-403a-9fd0-1b7016a62245 req-a7b287df-c231-482d-91dc-98b9bede58cd service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:11.525600 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-71c02215-a8b1-403a-9fd0-1b7016a62245 req-a7b287df-c231-482d-91dc-98b9bede58cd service nova] Creating event network-vif-deleted:ed000f62-7c20-4cbb-86b6-a2ea779e28b3 for instance 2cd59e94-4a47-4bee-8fa2-ff2540b37547 on hv-cinder-83716 Apr 11 16:52:11.532755 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-71c02215-a8b1-403a-9fd0-1b7016a62245 req-a7b287df-c231-482d-91dc-98b9bede58cd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039789 Apr 11 16:52:11.533568 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 539/1102] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:52:12.329438 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-432e15be-5d76-4c41-94e6-423f57e44e9e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:12.330034 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-432e15be-5d76-4c41-94e6-423f57e44e9e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:12.337710 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-432e15be-5d76-4c41-94e6-423f57e44e9e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:12.338168 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-432e15be-5d76-4c41-94e6-423f57e44e9e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:12.338938 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-432e15be-5d76-4c41-94e6-423f57e44e9e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:12.339404 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-432e15be-5d76-4c41-94e6-423f57e44e9e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:12.354200 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-432e15be-5d76-4c41-94e6-423f57e44e9e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] HTTP exception thrown: Instance 2cd59e94-4a47-4bee-8fa2-ff2540b37547 could not be found. Apr 11 16:52:12.354923 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-432e15be-5d76-4c41-94e6-423f57e44e9e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Returning 404 to user: Instance 2cd59e94-4a47-4bee-8fa2-ff2540b37547 could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:52:12.355814 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-432e15be-5d76-4c41-94e6-423f57e44e9e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547" status: 404 len: 111 microversion: 2.1 time: 0.030562 Apr 11 16:52:12.356395 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 564/1103] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:12 2022] GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:52:12.366664 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-03046ff5-259e-4c7f-8c26-53095cef8b79 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '.version_select at 0x7f7412df44c0>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:12.389728 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-03046ff5-259e-4c7f-8c26-53095cef8b79 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-863310420" status: 202 len: 0 microversion: 2.1 time: 0.026538 Apr 11 16:52:12.389728 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 540/1104] 10.222.0.65 () {58 vars in 1217 bytes} [Mon Apr 11 16:52:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-863310420 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:52:13.319007 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-07290e1f-65df-485c-a0f2-93075f07465b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Action: 'create', calling method: .version_select at 0x7f741822d280>, body: {"keypair": {"name": "tempest-keypair-2107162336"}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:52:13.334483 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-07290e1f-65df-485c-a0f2-93075f07465b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:52:13.338932 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-07290e1f-65df-485c-a0f2-93075f07465b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for user 089723b908ba4a25bb83de445b69561d and project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:52:13.513520 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-07290e1f-65df-485c-a0f2-93075f07465b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:52:13.517965 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-07290e1f-65df-485c-a0f2-93075f07465b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for user 089723b908ba4a25bb83de445b69561d and project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'key_pairs'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:52:13.531284 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-07290e1f-65df-485c-a0f2-93075f07465b tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.216297 Apr 11 16:52:13.531932 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 565/1105] 10.222.0.65 () {60 vars in 1157 bytes} [Mon Apr 11 16:52:13 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:14.554960 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-92224e86-3d08-487c-a7d8-36674ba24218 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:14.555949 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-92224e86-3d08-487c-a7d8-36674ba24218 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:14.564933 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-92224e86-3d08-487c-a7d8-36674ba24218 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:14.569908 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-92224e86-3d08-487c-a7d8-36674ba24218 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:14.570810 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-92224e86-3d08-487c-a7d8-36674ba24218 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:14.571313 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-92224e86-3d08-487c-a7d8-36674ba24218 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:14.612685 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-92224e86-3d08-487c-a7d8-36674ba24218 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Going to try to terminate instance {{(pid=123774) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:52:14.678184 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-b9099220-1782-4314-8d61-40e78f662b5c req-2ad68c73-9774-4f29-9435-d6271141abdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd8e3633-0aab-4e07-ac19-252cc15604aa", "tag": "36b6fa9b-53fb-486f-bde2-16297771bdc7"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:52:14.694318 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-b9099220-1782-4314-8d61-40e78f662b5c req-2ad68c73-9774-4f29-9435-d6271141abdb service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:14.695512 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-b9099220-1782-4314-8d61-40e78f662b5c req-2ad68c73-9774-4f29-9435-d6271141abdb service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:14.716612 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-b9099220-1782-4314-8d61-40e78f662b5c req-2ad68c73-9774-4f29-9435-d6271141abdb service nova] Creating event network-changed:36b6fa9b-53fb-486f-bde2-16297771bdc7 for instance bd8e3633-0aab-4e07-ac19-252cc15604aa on hv-cinder-83716 Apr 11 16:52:14.727016 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-b9099220-1782-4314-8d61-40e78f662b5c req-2ad68c73-9774-4f29-9435-d6271141abdb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169336 Apr 11 16:52:14.728423 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 566/1106] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:52:14.741092 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-92224e86-3d08-487c-a7d8-36674ba24218 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "DELETE /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 204 len: 0 microversion: 2.1 time: 0.190157 Apr 11 16:52:14.741723 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 541/1107] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:52:14 2022] DELETE /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:52:14.760979 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-e813324f-f734-44f5-ad4a-dbe722b10754 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:14.762165 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-e813324f-f734-44f5-ad4a-dbe722b10754 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:14.772393 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e813324f-f734-44f5-ad4a-dbe722b10754 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:14.773447 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e813324f-f734-44f5-ad4a-dbe722b10754 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:14.774993 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e813324f-f734-44f5-ad4a-dbe722b10754 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:14.775985 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e813324f-f734-44f5-ad4a-dbe722b10754 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:14.963701 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-e813324f-f734-44f5-ad4a-dbe722b10754 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:14.970045 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-e813324f-f734-44f5-ad4a-dbe722b10754 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 200 len: 1577 microversion: 2.1 time: 0.222657 Apr 11 16:52:14.970720 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 567/1108] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:14 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 1577 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:15.011619 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-559f224a-7424-4c6d-9894-71e2beb21dae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2008182600", "imageRef": "e989c938-7b7a-445c-aec9-596e81d35104", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64f8adf0-5b62-426a-b30a-0690e612962b"}], "security_groups": [{"name": "tempest-securitygroup--650228772"}], "key_name": "tempest-keypair-2107162336", "user_data": "}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:52:15.117598 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.network.neutron [None req-559f224a-7424-4c6d-9894-71e2beb21dae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] validate_networks() for [('64f8adf0-5b62-426a-b30a-0690e612962b', None, None, None, None, None)] {{(pid=123774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:52:15.508704 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-559f224a-7424-4c6d-9894-71e2beb21dae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Flavor limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:52:15.509136 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-559f224a-7424-4c6d-9894-71e2beb21dae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Image limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:52:15.509622 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-559f224a-7424-4c6d-9894-71e2beb21dae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Flavor pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:52:15.510004 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-559f224a-7424-4c6d-9894-71e2beb21dae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Image pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:52:15.510407 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-559f224a-7424-4c6d-9894-71e2beb21dae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:52:15.520398 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-559f224a-7424-4c6d-9894-71e2beb21dae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:15.521349 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-559f224a-7424-4c6d-9894-71e2beb21dae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:15.521652 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-559f224a-7424-4c6d-9894-71e2beb21dae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:15.522082 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-559f224a-7424-4c6d-9894-71e2beb21dae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:15.539965 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-559f224a-7424-4c6d-9894-71e2beb21dae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:52:15.545310 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-559f224a-7424-4c6d-9894-71e2beb21dae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Getting quotas for user 089723b908ba4a25bb83de445b69561d and project 52b7da8bf3624ca98fada39bdde438ee. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:52:15.558999 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-559f224a-7424-4c6d-9894-71e2beb21dae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Going to run 1 instances... {{(pid=123774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:52:15.561585 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-559f224a-7424-4c6d-9894-71e2beb21dae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e989c938-7b7a-445c-aec9-596e81d35104',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:52:15.613510 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-559f224a-7424-4c6d-9894-71e2beb21dae tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.606642 Apr 11 16:52:15.614353 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 542/1109] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Apr 11 16:52:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 16:52:15.625170 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1cc6ee19-9cd5-4ec2-9aa9-8e6c414dc97a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:15.625793 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1cc6ee19-9cd5-4ec2-9aa9-8e6c414dc97a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:15.686330 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1cc6ee19-9cd5-4ec2-9aa9-8e6c414dc97a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:15.693926 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1cc6ee19-9cd5-4ec2-9aa9-8e6c414dc97a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d" status: 200 len: 1242 microversion: 2.1 time: 0.073071 Apr 11 16:52:15.701009 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 568/1110] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:15 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:52:15.989126 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-9d454c31-8382-44fb-9b43-42b7bf165230 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:15.989709 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-9d454c31-8382-44fb-9b43-42b7bf165230 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:15.997005 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9d454c31-8382-44fb-9b43-42b7bf165230 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:15.997439 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9d454c31-8382-44fb-9b43-42b7bf165230 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:15.998173 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9d454c31-8382-44fb-9b43-42b7bf165230 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:15.998826 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-9d454c31-8382-44fb-9b43-42b7bf165230 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:16.142423 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-9d454c31-8382-44fb-9b43-42b7bf165230 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:16.150223 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-9d454c31-8382-44fb-9b43-42b7bf165230 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 200 len: 1577 microversion: 2.1 time: 0.165386 Apr 11 16:52:16.150807 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 543/1111] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:15 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:16.710480 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d21a77d2-4ea9-4fd5-bf2f-8dcbd931ade9 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:16.711213 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d21a77d2-4ea9-4fd5-bf2f-8dcbd931ade9 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:16.723149 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d21a77d2-4ea9-4fd5-bf2f-8dcbd931ade9 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:16.724047 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d21a77d2-4ea9-4fd5-bf2f-8dcbd931ade9 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:16.725045 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d21a77d2-4ea9-4fd5-bf2f-8dcbd931ade9 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:16.725473 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d21a77d2-4ea9-4fd5-bf2f-8dcbd931ade9 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:16.820287 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d21a77d2-4ea9-4fd5-bf2f-8dcbd931ade9 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:16.830512 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d21a77d2-4ea9-4fd5-bf2f-8dcbd931ade9 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d" status: 200 len: 1294 microversion: 2.1 time: 0.124023 Apr 11 16:52:16.831720 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 569/1112] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:16 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d => generated 1294 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:16.846327 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-9c74ce75-c046-4410-9fa2-7e5d037db422 req-fa972368-198b-418d-aec8-664500520ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd8e3633-0aab-4e07-ac19-252cc15604aa", "name": "network-vif-deleted", "tag": "36b6fa9b-53fb-486f-bde2-16297771bdc7"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:52:16.856167 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-9c74ce75-c046-4410-9fa2-7e5d037db422 req-fa972368-198b-418d-aec8-664500520ec5 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:16.856605 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-9c74ce75-c046-4410-9fa2-7e5d037db422 req-fa972368-198b-418d-aec8-664500520ec5 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:16.869288 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-9c74ce75-c046-4410-9fa2-7e5d037db422 req-fa972368-198b-418d-aec8-664500520ec5 service nova] Creating event network-vif-deleted:36b6fa9b-53fb-486f-bde2-16297771bdc7 for instance bd8e3633-0aab-4e07-ac19-252cc15604aa on hv-cinder-83716 Apr 11 16:52:16.875857 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-9c74ce75-c046-4410-9fa2-7e5d037db422 req-fa972368-198b-418d-aec8-664500520ec5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033456 Apr 11 16:52:16.882286 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 544/1113] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:52:17.167432 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-0a6180ac-36b2-4926-90ae-83434f2e8884 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:17.168350 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-0a6180ac-36b2-4926-90ae-83434f2e8884 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:17.175083 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0a6180ac-36b2-4926-90ae-83434f2e8884 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:17.175689 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0a6180ac-36b2-4926-90ae-83434f2e8884 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:17.176483 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0a6180ac-36b2-4926-90ae-83434f2e8884 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:17.176913 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0a6180ac-36b2-4926-90ae-83434f2e8884 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:17.210730 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0a6180ac-36b2-4926-90ae-83434f2e8884 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:17.211176 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0a6180ac-36b2-4926-90ae-83434f2e8884 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:17.211625 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.objects.instance [None req-0a6180ac-36b2-4926-90ae-83434f2e8884 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lazy-loading 'fault' on Instance uuid bd8e3633-0aab-4e07-ac19-252cc15604aa {{(pid=123773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:52:17.257191 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-0a6180ac-36b2-4926-90ae-83434f2e8884 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80844604b91746398c8ae7dde54d0dd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc3803567a904d698675781a5ccd07cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:17.266059 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-0a6180ac-36b2-4926-90ae-83434f2e8884 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 200 len: 1231 microversion: 2.1 time: 0.102839 Apr 11 16:52:17.266642 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 570/1114] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:17 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:17.849441 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-623b286c-6a1d-4ef4-8d2b-04a7c6b4f1dd tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:17.850004 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-623b286c-6a1d-4ef4-8d2b-04a7c6b4f1dd tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:17.857700 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-623b286c-6a1d-4ef4-8d2b-04a7c6b4f1dd tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:17.858140 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-623b286c-6a1d-4ef4-8d2b-04a7c6b4f1dd tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:17.858909 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-623b286c-6a1d-4ef4-8d2b-04a7c6b4f1dd tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:17.859330 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-623b286c-6a1d-4ef4-8d2b-04a7c6b4f1dd tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:17.996344 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-623b286c-6a1d-4ef4-8d2b-04a7c6b4f1dd tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:18.005695 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-623b286c-6a1d-4ef4-8d2b-04a7c6b4f1dd tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d" status: 200 len: 1367 microversion: 2.1 time: 0.161220 Apr 11 16:52:18.006323 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 545/1115] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:17 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:18.284223 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-76ca4bdd-42dd-4f69-8211-13dfe8c7aa3d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:18.284837 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-76ca4bdd-42dd-4f69-8211-13dfe8c7aa3d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bd8e3633-0aab-4e07-ac19-252cc15604aa] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:18.291342 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-76ca4bdd-42dd-4f69-8211-13dfe8c7aa3d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:18.291997 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-76ca4bdd-42dd-4f69-8211-13dfe8c7aa3d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:18.296611 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-76ca4bdd-42dd-4f69-8211-13dfe8c7aa3d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:18.297066 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-76ca4bdd-42dd-4f69-8211-13dfe8c7aa3d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:18.299596 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-890dcbdf-402e-4397-9bfb-b11978f0b942 req-59c94417-992a-40da-a415-22f1c280f3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec100401-cf1e-47ae-bcd7-a3ecc80da20d", "tag": "62a99744-9c7f-48c4-90f8-9e5b283818a0"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:52:18.312225 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-890dcbdf-402e-4397-9bfb-b11978f0b942 req-59c94417-992a-40da-a415-22f1c280f3f9 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:18.312924 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-890dcbdf-402e-4397-9bfb-b11978f0b942 req-59c94417-992a-40da-a415-22f1c280f3f9 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:18.313076 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-76ca4bdd-42dd-4f69-8211-13dfe8c7aa3d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] HTTP exception thrown: Instance bd8e3633-0aab-4e07-ac19-252cc15604aa could not be found. Apr 11 16:52:18.313644 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-76ca4bdd-42dd-4f69-8211-13dfe8c7aa3d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Returning 404 to user: Instance bd8e3633-0aab-4e07-ac19-252cc15604aa could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:52:18.314524 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-76ca4bdd-42dd-4f69-8211-13dfe8c7aa3d tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa" status: 404 len: 111 microversion: 2.1 time: 0.034928 Apr 11 16:52:18.315322 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 571/1116] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:18 2022] GET /compute/v2.1/servers/bd8e3633-0aab-4e07-ac19-252cc15604aa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:52:18.345752 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-890dcbdf-402e-4397-9bfb-b11978f0b942 req-59c94417-992a-40da-a415-22f1c280f3f9 service nova] Creating event network-changed:62a99744-9c7f-48c4-90f8-9e5b283818a0 for instance ec100401-cf1e-47ae-bcd7-a3ecc80da20d on hv-cinder-83716 Apr 11 16:52:18.354681 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-890dcbdf-402e-4397-9bfb-b11978f0b942 req-59c94417-992a-40da-a415-22f1c280f3f9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058586 Apr 11 16:52:18.356270 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 546/1117] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:52:18.797089 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-473eb8f5-8d71-441d-adfc-cc8bbc3d88fe tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:18.797767 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-473eb8f5-8d71-441d-adfc-cc8bbc3d88fe tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:18.806944 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-473eb8f5-8d71-441d-adfc-cc8bbc3d88fe tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:18.807481 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-473eb8f5-8d71-441d-adfc-cc8bbc3d88fe tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:18.808278 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-473eb8f5-8d71-441d-adfc-cc8bbc3d88fe tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:18.808712 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-473eb8f5-8d71-441d-adfc-cc8bbc3d88fe tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:18.823089 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-473eb8f5-8d71-441d-adfc-cc8bbc3d88fe tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] HTTP exception thrown: Instance bb39f773-fda3-4634-8e69-055b9315e3ba could not be found. Apr 11 16:52:18.823613 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-473eb8f5-8d71-441d-adfc-cc8bbc3d88fe tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Returning 404 to user: Instance bb39f773-fda3-4634-8e69-055b9315e3ba could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:52:18.824477 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-473eb8f5-8d71-441d-adfc-cc8bbc3d88fe tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "DELETE /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 404 len: 111 microversion: 2.1 time: 0.033554 Apr 11 16:52:18.825023 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 572/1118] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:52:18 2022] DELETE /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:52:18.839130 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-514c406e-31bd-4997-8af7-e82303249ce3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:18.839938 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-514c406e-31bd-4997-8af7-e82303249ce3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] [instance: bb39f773-fda3-4634-8e69-055b9315e3ba] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:18.846952 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-514c406e-31bd-4997-8af7-e82303249ce3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:18.847395 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-514c406e-31bd-4997-8af7-e82303249ce3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:18.848196 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-514c406e-31bd-4997-8af7-e82303249ce3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:18.848631 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-514c406e-31bd-4997-8af7-e82303249ce3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:18.863400 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-514c406e-31bd-4997-8af7-e82303249ce3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] HTTP exception thrown: Instance bb39f773-fda3-4634-8e69-055b9315e3ba could not be found. Apr 11 16:52:18.864030 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-514c406e-31bd-4997-8af7-e82303249ce3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Returning 404 to user: Instance bb39f773-fda3-4634-8e69-055b9315e3ba could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:52:18.864869 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-514c406e-31bd-4997-8af7-e82303249ce3 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba" status: 404 len: 111 microversion: 2.1 time: 0.032825 Apr 11 16:52:18.865415 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 547/1119] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:18 2022] GET /compute/v2.1/servers/bb39f773-fda3-4634-8e69-055b9315e3ba => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:52:19.023035 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-0b205f30-f160-4d9c-ac47-7fea4783acbb tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:19.023797 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-0b205f30-f160-4d9c-ac47-7fea4783acbb tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:19.031258 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0b205f30-f160-4d9c-ac47-7fea4783acbb tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:19.031739 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0b205f30-f160-4d9c-ac47-7fea4783acbb tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:19.032579 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0b205f30-f160-4d9c-ac47-7fea4783acbb tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:19.033011 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0b205f30-f160-4d9c-ac47-7fea4783acbb tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:19.189260 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-0b205f30-f160-4d9c-ac47-7fea4783acbb tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:19.196778 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-0b205f30-f160-4d9c-ac47-7fea4783acbb tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d" status: 200 len: 1367 microversion: 2.1 time: 0.178087 Apr 11 16:52:19.197320 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 573/1120] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:19 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:20.211230 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-397b1183-6264-4278-bde4-5a8a4d383c81 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] Calling method '.version_select at 0x7f7412d9a310>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:20.219615 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1963336f-08a3-4593-9970-33cc092951c4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:20.220338 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1963336f-08a3-4593-9970-33cc092951c4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:20.228292 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1963336f-08a3-4593-9970-33cc092951c4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:20.228872 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1963336f-08a3-4593-9970-33cc092951c4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:20.229940 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1963336f-08a3-4593-9970-33cc092951c4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:20.230622 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1963336f-08a3-4593-9970-33cc092951c4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:20.234109 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-397b1183-6264-4278-bde4-5a8a4d383c81 tempest-TestVolumeBootPattern-1516720463 tempest-TestVolumeBootPattern-1516720463-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1851676367" status: 202 len: 0 microversion: 2.1 time: 0.026707 Apr 11 16:52:20.235594 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 548/1121] 10.222.0.65 () {58 vars in 1262 bytes} [Mon Apr 11 16:52:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1851676367 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:52:20.370905 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1963336f-08a3-4593-9970-33cc092951c4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:20.378430 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1963336f-08a3-4593-9970-33cc092951c4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d" status: 200 len: 1367 microversion: 2.1 time: 0.163792 Apr 11 16:52:20.379045 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 574/1122] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:20 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:52:21.396479 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-1e9fe134-e57e-479b-a6a7-480587865344 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:21.397169 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-1e9fe134-e57e-479b-a6a7-480587865344 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:21.408479 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1e9fe134-e57e-479b-a6a7-480587865344 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:21.409322 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1e9fe134-e57e-479b-a6a7-480587865344 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:21.410240 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1e9fe134-e57e-479b-a6a7-480587865344 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:21.410669 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1e9fe134-e57e-479b-a6a7-480587865344 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:21.546936 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-1e9fe134-e57e-479b-a6a7-480587865344 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:21.556104 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-1e9fe134-e57e-479b-a6a7-480587865344 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d" status: 200 len: 1367 microversion: 2.1 time: 0.164044 Apr 11 16:52:21.556791 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 549/1123] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:21 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:22.574694 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-b6fda28e-10f9-438e-afa0-6fffbf03af42 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:22.575721 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-b6fda28e-10f9-438e-afa0-6fffbf03af42 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:22.582516 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6fda28e-10f9-438e-afa0-6fffbf03af42 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:22.583086 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6fda28e-10f9-438e-afa0-6fffbf03af42 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:22.583991 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6fda28e-10f9-438e-afa0-6fffbf03af42 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:22.584512 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-b6fda28e-10f9-438e-afa0-6fffbf03af42 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:22.724254 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-b6fda28e-10f9-438e-afa0-6fffbf03af42 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:22.731931 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-b6fda28e-10f9-438e-afa0-6fffbf03af42 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d" status: 200 len: 1367 microversion: 2.1 time: 0.161247 Apr 11 16:52:22.732966 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 575/1124] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:22 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:23.749646 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-413e3ea2-ffd2-4ff0-9df8-1b3bfb6d976d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:23.750280 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-413e3ea2-ffd2-4ff0-9df8-1b3bfb6d976d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:23.756941 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-413e3ea2-ffd2-4ff0-9df8-1b3bfb6d976d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:23.758224 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-413e3ea2-ffd2-4ff0-9df8-1b3bfb6d976d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:23.759106 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-413e3ea2-ffd2-4ff0-9df8-1b3bfb6d976d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:23.759741 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-413e3ea2-ffd2-4ff0-9df8-1b3bfb6d976d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:24.022326 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-413e3ea2-ffd2-4ff0-9df8-1b3bfb6d976d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:24.044890 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-413e3ea2-ffd2-4ff0-9df8-1b3bfb6d976d tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d" status: 200 len: 1367 microversion: 2.1 time: 0.299015 Apr 11 16:52:24.054276 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 550/1125] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:23 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:25.062119 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-4c2daa3a-4cb9-46c7-be11-5eabb9511a2a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:25.062761 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-4c2daa3a-4cb9-46c7-be11-5eabb9511a2a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:25.070274 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4c2daa3a-4cb9-46c7-be11-5eabb9511a2a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:25.070965 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4c2daa3a-4cb9-46c7-be11-5eabb9511a2a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:25.071852 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4c2daa3a-4cb9-46c7-be11-5eabb9511a2a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:25.072215 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-4c2daa3a-4cb9-46c7-be11-5eabb9511a2a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:25.229563 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-4c2daa3a-4cb9-46c7-be11-5eabb9511a2a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:25.238954 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-4c2daa3a-4cb9-46c7-be11-5eabb9511a2a tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d" status: 200 len: 1367 microversion: 2.1 time: 0.180647 Apr 11 16:52:25.246005 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 576/1126] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:25 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:26.256903 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-10aa062a-0dac-45fd-a845-3d6ed6944a8c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:26.258268 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-10aa062a-0dac-45fd-a845-3d6ed6944a8c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:26.267717 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-10aa062a-0dac-45fd-a845-3d6ed6944a8c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:26.268397 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-10aa062a-0dac-45fd-a845-3d6ed6944a8c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:26.269354 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-10aa062a-0dac-45fd-a845-3d6ed6944a8c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:26.269933 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-10aa062a-0dac-45fd-a845-3d6ed6944a8c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:26.349950 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-fbba7429-a056-4111-9106-9e94f3110a9c req-e9b5297c-7771-4fad-8916-92ed90cf1d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec100401-cf1e-47ae-bcd7-a3ecc80da20d", "name": "network-vif-plugged", "status": "completed", "tag": "62a99744-9c7f-48c4-90f8-9e5b283818a0"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:52:26.364556 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-fbba7429-a056-4111-9106-9e94f3110a9c req-e9b5297c-7771-4fad-8916-92ed90cf1d21 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:26.367093 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-fbba7429-a056-4111-9106-9e94f3110a9c req-e9b5297c-7771-4fad-8916-92ed90cf1d21 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:26.382902 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-fbba7429-a056-4111-9106-9e94f3110a9c req-e9b5297c-7771-4fad-8916-92ed90cf1d21 service nova] Creating event network-vif-plugged:62a99744-9c7f-48c4-90f8-9e5b283818a0 for instance ec100401-cf1e-47ae-bcd7-a3ecc80da20d on hv-cinder-83716 Apr 11 16:52:26.397011 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-fbba7429-a056-4111-9106-9e94f3110a9c req-e9b5297c-7771-4fad-8916-92ed90cf1d21 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049083 Apr 11 16:52:26.398166 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 577/1127] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:52:26.466270 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-10aa062a-0dac-45fd-a845-3d6ed6944a8c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:26.474366 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-10aa062a-0dac-45fd-a845-3d6ed6944a8c tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d" status: 200 len: 1367 microversion: 2.1 time: 0.221379 Apr 11 16:52:26.475003 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 551/1128] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:26 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:27.494360 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-6069e7bb-1665-4440-8fcd-e463cd0bb3d4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:27.495096 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-6069e7bb-1665-4440-8fcd-e463cd0bb3d4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:27.503582 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6069e7bb-1665-4440-8fcd-e463cd0bb3d4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:27.504081 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6069e7bb-1665-4440-8fcd-e463cd0bb3d4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:27.505031 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6069e7bb-1665-4440-8fcd-e463cd0bb3d4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:27.505636 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6069e7bb-1665-4440-8fcd-e463cd0bb3d4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:27.734786 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6069e7bb-1665-4440-8fcd-e463cd0bb3d4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:27.742342 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-6069e7bb-1665-4440-8fcd-e463cd0bb3d4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d" status: 200 len: 1367 microversion: 2.1 time: 0.252559 Apr 11 16:52:27.742915 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 578/1129] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:27 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:28.758537 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-67c51a6c-117e-4934-b37b-161576eab211 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:28.759137 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-67c51a6c-117e-4934-b37b-161576eab211 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:28.765862 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-67c51a6c-117e-4934-b37b-161576eab211 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:28.766308 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-67c51a6c-117e-4934-b37b-161576eab211 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:28.767070 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-67c51a6c-117e-4934-b37b-161576eab211 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:28.767496 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-67c51a6c-117e-4934-b37b-161576eab211 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:29.196848 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-67c51a6c-117e-4934-b37b-161576eab211 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:52:29.204611 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-67c51a6c-117e-4934-b37b-161576eab211 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d" status: 200 len: 1557 microversion: 2.1 time: 0.449886 Apr 11 16:52:29.205192 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 552/1130] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:52:28 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d => generated 1557 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:52:29.221483 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-495dbea0-7443-41f0-9e33-6752fab763f4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:52:29.222026 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-495dbea0-7443-41f0-9e33-6752fab763f4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:52:29.229098 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-495dbea0-7443-41f0-9e33-6752fab763f4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:29.229551 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-495dbea0-7443-41f0-9e33-6752fab763f4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:29.230335 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-495dbea0-7443-41f0-9e33-6752fab763f4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:29.230763 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-495dbea0-7443-41f0-9e33-6752fab763f4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:29.316917 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-495dbea0-7443-41f0-9e33-6752fab763f4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099196 Apr 11 16:52:29.317526 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 579/1131] 10.222.0.65 () {58 vars in 1274 bytes} [Mon Apr 11 16:52:29 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:52:30.359136 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-d92b057c-9a28-4a0a-8a9b-a7f9ea79f91a req-69da224c-54a3-474c-9904-fc59b8555488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec100401-cf1e-47ae-bcd7-a3ecc80da20d", "tag": "62a99744-9c7f-48c4-90f8-9e5b283818a0"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:52:30.367383 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-d92b057c-9a28-4a0a-8a9b-a7f9ea79f91a req-69da224c-54a3-474c-9904-fc59b8555488 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:52:30.367864 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-d92b057c-9a28-4a0a-8a9b-a7f9ea79f91a req-69da224c-54a3-474c-9904-fc59b8555488 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:52:30.379212 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-d92b057c-9a28-4a0a-8a9b-a7f9ea79f91a req-69da224c-54a3-474c-9904-fc59b8555488 service nova] Creating event network-changed:62a99744-9c7f-48c4-90f8-9e5b283818a0 for instance ec100401-cf1e-47ae-bcd7-a3ecc80da20d on hv-cinder-83716 Apr 11 16:52:30.384401 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-d92b057c-9a28-4a0a-8a9b-a7f9ea79f91a req-69da224c-54a3-474c-9904-fc59b8555488 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029458 Apr 11 16:52:30.385445 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 553/1132] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:53:45.725973 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-2ee781d5-9993-4076-a5f3-98a417106a3f tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:53:45.726675 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-2ee781d5-9993-4076-a5f3-98a417106a3f tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:53:45.733426 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2ee781d5-9993-4076-a5f3-98a417106a3f tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:45.733866 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2ee781d5-9993-4076-a5f3-98a417106a3f tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:45.734622 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2ee781d5-9993-4076-a5f3-98a417106a3f tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:45.735044 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2ee781d5-9993-4076-a5f3-98a417106a3f tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:45.758326 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-2ee781d5-9993-4076-a5f3-98a417106a3f tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d/ips" status: 200 len: 149 microversion: 2.1 time: 0.038190 Apr 11 16:53:45.758907 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 580/1133] 10.222.0.65 () {58 vars in 1247 bytes} [Mon Apr 11 16:53:45 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:53:47.080494 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d4a4329c-4f45-4236-9ec3-9b22e9647c98 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5798c96-5ea8-4734-9353-4add3084f3ab"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:53:47.081687 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d4a4329c-4f45-4236-9ec3-9b22e9647c98 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:53:47.088979 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d4a4329c-4f45-4236-9ec3-9b22e9647c98 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:47.091478 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d4a4329c-4f45-4236-9ec3-9b22e9647c98 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:47.091478 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d4a4329c-4f45-4236-9ec3-9b22e9647c98 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:47.091478 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d4a4329c-4f45-4236-9ec3-9b22e9647c98 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:47.338273 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d4a4329c-4f45-4236-9ec3-9b22e9647c98 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "POST /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263557 Apr 11 16:53:47.338876 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 554/1134] 10.222.0.65 () {60 vars in 1322 bytes} [Mon Apr 11 16:53:47 2022] POST /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:53:54.944814 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-03daf17e-a1df-46b9-ac91-e004d5c0eaaf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:53:54.945364 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-03daf17e-a1df-46b9-ac91-e004d5c0eaaf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:53:54.952206 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-03daf17e-a1df-46b9-ac91-e004d5c0eaaf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:54.952642 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-03daf17e-a1df-46b9-ac91-e004d5c0eaaf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:54.953405 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-03daf17e-a1df-46b9-ac91-e004d5c0eaaf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:54.953829 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-03daf17e-a1df-46b9-ac91-e004d5c0eaaf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:55.034574 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.objects.instance [None req-03daf17e-a1df-46b9-ac91-e004d5c0eaaf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lazy-loading 'services' on Instance uuid ec100401-cf1e-47ae-bcd7-a3ecc80da20d {{(pid=123773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:53:55.108731 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-03daf17e-a1df-46b9-ac91-e004d5c0eaaf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d/os-volume_attachments/f5798c96-5ea8-4734-9353-4add3084f3ab" status: 202 len: 0 microversion: 2.1 time: 0.167621 Apr 11 16:53:55.109346 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 581/1135] 10.222.0.65 () {58 vars in 1415 bytes} [Mon Apr 11 16:53:54 2022] DELETE /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d/os-volume_attachments/f5798c96-5ea8-4734-9353-4add3084f3ab => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 16:53:55.119529 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c9b904a6-9a33-49c2-8d17-638345844864 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:53:55.120704 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c9b904a6-9a33-49c2-8d17-638345844864 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:53:55.127766 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c9b904a6-9a33-49c2-8d17-638345844864 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:55.128236 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c9b904a6-9a33-49c2-8d17-638345844864 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:55.129057 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c9b904a6-9a33-49c2-8d17-638345844864 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:55.129698 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c9b904a6-9a33-49c2-8d17-638345844864 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:55.162868 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c9b904a6-9a33-49c2-8d17-638345844864 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048540 Apr 11 16:53:55.163668 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 555/1136] 10.222.0.65 () {58 vars in 1301 bytes} [Mon Apr 11 16:53:55 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:53:56.177273 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-2d50ed49-0a72-4ddc-9d95-9001bf653a84 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:53:56.178347 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-2d50ed49-0a72-4ddc-9d95-9001bf653a84 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:53:56.185279 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2d50ed49-0a72-4ddc-9d95-9001bf653a84 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:56.185714 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2d50ed49-0a72-4ddc-9d95-9001bf653a84 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:56.186533 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2d50ed49-0a72-4ddc-9d95-9001bf653a84 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:56.186969 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2d50ed49-0a72-4ddc-9d95-9001bf653a84 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:56.217275 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-2d50ed49-0a72-4ddc-9d95-9001bf653a84 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044851 Apr 11 16:53:56.217891 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 582/1137] 10.222.0.65 () {58 vars in 1301 bytes} [Mon Apr 11 16:53:56 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 16:53:56.277001 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-f5507ab8-61a2-4594-a7a1-340c81d242ba tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:53:56.277605 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f5507ab8-61a2-4594-a7a1-340c81d242ba tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:53:56.284463 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f5507ab8-61a2-4594-a7a1-340c81d242ba tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:56.284847 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f5507ab8-61a2-4594-a7a1-340c81d242ba tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:56.285614 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f5507ab8-61a2-4594-a7a1-340c81d242ba tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:56.286048 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-f5507ab8-61a2-4594-a7a1-340c81d242ba tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:56.311007 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-f5507ab8-61a2-4594-a7a1-340c81d242ba tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Going to try to terminate instance {{(pid=123774) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:53:56.399388 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-f5507ab8-61a2-4594-a7a1-340c81d242ba tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d" status: 204 len: 0 microversion: 2.1 time: 0.126155 Apr 11 16:53:56.400135 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 556/1138] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:53:56 2022] DELETE /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:53:56.408952 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-13ee8a6b-d826-48a8-90e3-cc177c4e77f0 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:53:56.409541 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-13ee8a6b-d826-48a8-90e3-cc177c4e77f0 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:53:56.416561 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-13ee8a6b-d826-48a8-90e3-cc177c4e77f0 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:56.417003 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-13ee8a6b-d826-48a8-90e3-cc177c4e77f0 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:56.417776 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-13ee8a6b-d826-48a8-90e3-cc177c4e77f0 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:56.418221 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-13ee8a6b-d826-48a8-90e3-cc177c4e77f0 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:56.556962 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-13ee8a6b-d826-48a8-90e3-cc177c4e77f0 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:53:56.565020 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-13ee8a6b-d826-48a8-90e3-cc177c4e77f0 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d" status: 200 len: 1681 microversion: 2.1 time: 0.160342 Apr 11 16:53:56.565608 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 583/1139] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:53:56 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:53:57.584069 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-0382499d-68b4-4287-a0e3-bc63108b7793 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:53:57.584765 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-0382499d-68b4-4287-a0e3-bc63108b7793 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:53:57.592019 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0382499d-68b4-4287-a0e3-bc63108b7793 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:57.592462 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0382499d-68b4-4287-a0e3-bc63108b7793 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:57.593240 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0382499d-68b4-4287-a0e3-bc63108b7793 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:57.593678 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0382499d-68b4-4287-a0e3-bc63108b7793 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:57.726249 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0382499d-68b4-4287-a0e3-bc63108b7793 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:53:57.734987 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-0382499d-68b4-4287-a0e3-bc63108b7793 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d" status: 200 len: 1681 microversion: 2.1 time: 0.156057 Apr 11 16:53:57.735589 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 557/1140] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:53:57 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:53:58.753943 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d60aff31-cba7-4c59-855f-b76aa44b1e29 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:53:58.754614 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d60aff31-cba7-4c59-855f-b76aa44b1e29 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:53:58.761762 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d60aff31-cba7-4c59-855f-b76aa44b1e29 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:58.762185 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d60aff31-cba7-4c59-855f-b76aa44b1e29 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:58.762984 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d60aff31-cba7-4c59-855f-b76aa44b1e29 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:58.763441 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d60aff31-cba7-4c59-855f-b76aa44b1e29 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:58.826960 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d60aff31-cba7-4c59-855f-b76aa44b1e29 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '089723b908ba4a25bb83de445b69561d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b7da8bf3624ca98fada39bdde438ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:53:58.835009 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d60aff31-cba7-4c59-855f-b76aa44b1e29 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d" status: 200 len: 1614 microversion: 2.1 time: 0.084824 Apr 11 16:53:58.835943 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 584/1141] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:53:58 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d => generated 1614 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:53:59.194055 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-c256a986-d541-49c2-b8f2-6e557693589f req-13aa09c3-200a-410d-83ed-c54c1e250905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec100401-cf1e-47ae-bcd7-a3ecc80da20d", "name": "network-vif-deleted", "tag": "62a99744-9c7f-48c4-90f8-9e5b283818a0"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:53:59.205084 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-c256a986-d541-49c2-b8f2-6e557693589f req-13aa09c3-200a-410d-83ed-c54c1e250905 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:59.205515 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-c256a986-d541-49c2-b8f2-6e557693589f req-13aa09c3-200a-410d-83ed-c54c1e250905 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:59.218594 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-c256a986-d541-49c2-b8f2-6e557693589f req-13aa09c3-200a-410d-83ed-c54c1e250905 service nova] Creating event network-vif-deleted:62a99744-9c7f-48c4-90f8-9e5b283818a0 for instance ec100401-cf1e-47ae-bcd7-a3ecc80da20d on hv-cinder-83716 Apr 11 16:53:59.224543 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-c256a986-d541-49c2-b8f2-6e557693589f req-13aa09c3-200a-410d-83ed-c54c1e250905 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201068 Apr 11 16:53:59.230936 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 558/1142] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:53:59.853253 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-2a9a6efd-3c1b-4790-85ea-282d1ca09794 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:53:59.854062 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-2a9a6efd-3c1b-4790-85ea-282d1ca09794 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:53:59.861400 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2a9a6efd-3c1b-4790-85ea-282d1ca09794 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:59.861847 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2a9a6efd-3c1b-4790-85ea-282d1ca09794 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:59.862625 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2a9a6efd-3c1b-4790-85ea-282d1ca09794 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:53:59.864137 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2a9a6efd-3c1b-4790-85ea-282d1ca09794 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:53:59.878766 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-2a9a6efd-3c1b-4790-85ea-282d1ca09794 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] HTTP exception thrown: Instance ec100401-cf1e-47ae-bcd7-a3ecc80da20d could not be found. Apr 11 16:53:59.879374 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-2a9a6efd-3c1b-4790-85ea-282d1ca09794 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Returning 404 to user: Instance ec100401-cf1e-47ae-bcd7-a3ecc80da20d could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:53:59.880259 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-2a9a6efd-3c1b-4790-85ea-282d1ca09794 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d" status: 404 len: 111 microversion: 2.1 time: 0.031245 Apr 11 16:53:59.880824 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 585/1143] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:53:59 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:53:59.892236 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-8546b9a1-9840-41fa-81a3-857b1a415be4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '.version_select at 0x7f7412df4670>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:53:59.912125 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-8546b9a1-9840-41fa-81a3-857b1a415be4 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2107162336" status: 202 len: 0 microversion: 2.1 time: 0.023888 Apr 11 16:53:59.912720 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 559/1144] 10.222.0.65 () {58 vars in 1220 bytes} [Mon Apr 11 16:53:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2107162336 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 16:54:01.709698 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-0fffe34b-7b9a-47d0-b1cb-574708d45023 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:54:01.710312 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-0fffe34b-7b9a-47d0-b1cb-574708d45023 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:54:01.717032 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0fffe34b-7b9a-47d0-b1cb-574708d45023 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:54:01.717480 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0fffe34b-7b9a-47d0-b1cb-574708d45023 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:54:01.718324 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0fffe34b-7b9a-47d0-b1cb-574708d45023 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:54:01.718756 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-0fffe34b-7b9a-47d0-b1cb-574708d45023 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:54:01.734037 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-0fffe34b-7b9a-47d0-b1cb-574708d45023 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] HTTP exception thrown: Instance ec100401-cf1e-47ae-bcd7-a3ecc80da20d could not be found. Apr 11 16:54:01.734636 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-0fffe34b-7b9a-47d0-b1cb-574708d45023 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Returning 404 to user: Instance ec100401-cf1e-47ae-bcd7-a3ecc80da20d could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:54:01.735469 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-0fffe34b-7b9a-47d0-b1cb-574708d45023 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d" status: 404 len: 111 microversion: 2.1 time: 0.029902 Apr 11 16:54:01.736080 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 586/1145] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:54:01 2022] DELETE /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:54:01.745239 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-1e5c1ef8-ae46-44fb-9eb8-a4267786b0f8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:54:01.745970 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-1e5c1ef8-ae46-44fb-9eb8-a4267786b0f8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: ec100401-cf1e-47ae-bcd7-a3ecc80da20d] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:54:01.752803 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1e5c1ef8-ae46-44fb-9eb8-a4267786b0f8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:54:01.753231 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1e5c1ef8-ae46-44fb-9eb8-a4267786b0f8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:54:01.754018 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1e5c1ef8-ae46-44fb-9eb8-a4267786b0f8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:54:01.754449 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-1e5c1ef8-ae46-44fb-9eb8-a4267786b0f8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:54:01.768247 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-1e5c1ef8-ae46-44fb-9eb8-a4267786b0f8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] HTTP exception thrown: Instance ec100401-cf1e-47ae-bcd7-a3ecc80da20d could not be found. Apr 11 16:54:01.768837 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-1e5c1ef8-ae46-44fb-9eb8-a4267786b0f8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Returning 404 to user: Instance ec100401-cf1e-47ae-bcd7-a3ecc80da20d could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:54:01.769689 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-1e5c1ef8-ae46-44fb-9eb8-a4267786b0f8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d" status: 404 len: 111 microversion: 2.1 time: 0.029340 Apr 11 16:54:01.770258 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 560/1146] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:54:01 2022] GET /compute/v2.1/servers/ec100401-cf1e-47ae-bcd7-a3ecc80da20d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:54:02.911785 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-dcdfed00-b8d2-4c35-b058-53669364e505 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:54:02.912356 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-dcdfed00-b8d2-4c35-b058-53669364e505 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:54:02.918974 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dcdfed00-b8d2-4c35-b058-53669364e505 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:54:02.919411 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dcdfed00-b8d2-4c35-b058-53669364e505 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:54:02.920234 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dcdfed00-b8d2-4c35-b058-53669364e505 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:54:02.920658 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-dcdfed00-b8d2-4c35-b058-53669364e505 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:54:02.934940 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-dcdfed00-b8d2-4c35-b058-53669364e505 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] HTTP exception thrown: Instance 2cd59e94-4a47-4bee-8fa2-ff2540b37547 could not be found. Apr 11 16:54:02.935530 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-dcdfed00-b8d2-4c35-b058-53669364e505 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Returning 404 to user: Instance 2cd59e94-4a47-4bee-8fa2-ff2540b37547 could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:54:02.936384 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-dcdfed00-b8d2-4c35-b058-53669364e505 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547" status: 404 len: 111 microversion: 2.1 time: 0.029112 Apr 11 16:54:02.936966 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 587/1147] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:54:02 2022] DELETE /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:54:02.945437 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e7e62e73-7b5d-4ad4-b426-c47bb83c25cf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:54:02.946098 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e7e62e73-7b5d-4ad4-b426-c47bb83c25cf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 2cd59e94-4a47-4bee-8fa2-ff2540b37547] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:54:02.952644 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e7e62e73-7b5d-4ad4-b426-c47bb83c25cf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:54:02.953102 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e7e62e73-7b5d-4ad4-b426-c47bb83c25cf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:54:02.953858 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e7e62e73-7b5d-4ad4-b426-c47bb83c25cf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:54:02.954285 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e7e62e73-7b5d-4ad4-b426-c47bb83c25cf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:54:02.967531 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-e7e62e73-7b5d-4ad4-b426-c47bb83c25cf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] HTTP exception thrown: Instance 2cd59e94-4a47-4bee-8fa2-ff2540b37547 could not be found. Apr 11 16:54:02.968141 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e7e62e73-7b5d-4ad4-b426-c47bb83c25cf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Returning 404 to user: Instance 2cd59e94-4a47-4bee-8fa2-ff2540b37547 could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:54:02.968953 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e7e62e73-7b5d-4ad4-b426-c47bb83c25cf tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547" status: 404 len: 111 microversion: 2.1 time: 0.027640 Apr 11 16:54:02.969496 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 561/1148] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:54:02 2022] GET /compute/v2.1/servers/2cd59e94-4a47-4bee-8fa2-ff2540b37547 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:54:02.978016 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ebef1ada-2d77-49bd-bfca-d127566a9340 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:54:02.978507 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ebef1ada-2d77-49bd-bfca-d127566a9340 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:54:02.985205 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ebef1ada-2d77-49bd-bfca-d127566a9340 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:54:02.985658 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ebef1ada-2d77-49bd-bfca-d127566a9340 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:54:02.986418 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ebef1ada-2d77-49bd-bfca-d127566a9340 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:54:02.986849 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ebef1ada-2d77-49bd-bfca-d127566a9340 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:54:03.000373 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-ebef1ada-2d77-49bd-bfca-d127566a9340 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] HTTP exception thrown: Instance 23ca07a6-3b06-4768-a6f8-0e88240dbad5 could not be found. Apr 11 16:54:03.000970 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ebef1ada-2d77-49bd-bfca-d127566a9340 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Returning 404 to user: Instance 23ca07a6-3b06-4768-a6f8-0e88240dbad5 could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:54:03.001830 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ebef1ada-2d77-49bd-bfca-d127566a9340 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "DELETE /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5" status: 404 len: 111 microversion: 2.1 time: 0.027894 Apr 11 16:54:03.002382 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 588/1149] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:54:02 2022] DELETE /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:54:03.010702 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5066dce8-d253-4128-983b-4e67626ef6c8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:54:03.011305 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5066dce8-d253-4128-983b-4e67626ef6c8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: 23ca07a6-3b06-4768-a6f8-0e88240dbad5] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:54:03.017467 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5066dce8-d253-4128-983b-4e67626ef6c8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:54:03.017903 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5066dce8-d253-4128-983b-4e67626ef6c8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:54:03.018674 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5066dce8-d253-4128-983b-4e67626ef6c8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:54:03.019157 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5066dce8-d253-4128-983b-4e67626ef6c8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:54:03.033293 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-5066dce8-d253-4128-983b-4e67626ef6c8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] HTTP exception thrown: Instance 23ca07a6-3b06-4768-a6f8-0e88240dbad5 could not be found. Apr 11 16:54:03.033888 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5066dce8-d253-4128-983b-4e67626ef6c8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Returning 404 to user: Instance 23ca07a6-3b06-4768-a6f8-0e88240dbad5 could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:54:03.034721 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5066dce8-d253-4128-983b-4e67626ef6c8 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5" status: 404 len: 111 microversion: 2.1 time: 0.028052 Apr 11 16:54:03.035284 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 562/1150] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:54:03 2022] GET /compute/v2.1/servers/23ca07a6-3b06-4768-a6f8-0e88240dbad5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:54:04.175201 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-e04a1971-f267-4625-88a7-fcc5d79fbad3 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:54:04.175930 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-e04a1971-f267-4625-88a7-fcc5d79fbad3 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:54:04.182586 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e04a1971-f267-4625-88a7-fcc5d79fbad3 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:54:04.183017 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e04a1971-f267-4625-88a7-fcc5d79fbad3 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:54:04.183825 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e04a1971-f267-4625-88a7-fcc5d79fbad3 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:54:04.184235 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e04a1971-f267-4625-88a7-fcc5d79fbad3 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:54:04.198185 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-e04a1971-f267-4625-88a7-fcc5d79fbad3 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] HTTP exception thrown: Instance f8ba9b74-1ca3-4c03-b88e-c398753a5247 could not be found. Apr 11 16:54:04.198785 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-e04a1971-f267-4625-88a7-fcc5d79fbad3 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Returning 404 to user: Instance f8ba9b74-1ca3-4c03-b88e-c398753a5247 could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:54:04.199605 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-e04a1971-f267-4625-88a7-fcc5d79fbad3 tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247" status: 404 len: 111 microversion: 2.1 time: 0.028489 Apr 11 16:54:04.200271 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 589/1151] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:54:04 2022] DELETE /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:54:04.208497 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-aa3e91bf-e15e-4bf0-a2fa-a220a576d94e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:54:04.209077 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-aa3e91bf-e15e-4bf0-a2fa-a220a576d94e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] [instance: f8ba9b74-1ca3-4c03-b88e-c398753a5247] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:54:04.215783 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-aa3e91bf-e15e-4bf0-a2fa-a220a576d94e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:54:04.216228 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-aa3e91bf-e15e-4bf0-a2fa-a220a576d94e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:54:04.216999 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-aa3e91bf-e15e-4bf0-a2fa-a220a576d94e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:54:04.217428 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-aa3e91bf-e15e-4bf0-a2fa-a220a576d94e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:54:04.231522 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-aa3e91bf-e15e-4bf0-a2fa-a220a576d94e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] HTTP exception thrown: Instance f8ba9b74-1ca3-4c03-b88e-c398753a5247 could not be found. Apr 11 16:54:04.232195 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-aa3e91bf-e15e-4bf0-a2fa-a220a576d94e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] Returning 404 to user: Instance f8ba9b74-1ca3-4c03-b88e-c398753a5247 could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:54:04.233023 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-aa3e91bf-e15e-4bf0-a2fa-a220a576d94e tempest-AttachVolumeNegativeTest-285514697 tempest-AttachVolumeNegativeTest-285514697-project] 10.222.0.65 "GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247" status: 404 len: 111 microversion: 2.1 time: 0.028452 Apr 11 16:54:04.233585 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 563/1152] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:54:04 2022] GET /compute/v2.1/servers/f8ba9b74-1ca3-4c03-b88e-c398753a5247 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:55:10.818792 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-f14e1c97-b1e2-485e-a7a7-0db96bb9951b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1642653003", "imageRef": "e989c938-7b7a-445c-aec9-596e81d35104", "flavorRef": "452", "networks": [{"uuid": "53f83aaa-eb53-43e9-a9df-2ff2270fd36f"}]}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:55:10.876719 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.network.neutron [None req-f14e1c97-b1e2-485e-a7a7-0db96bb9951b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] validate_networks() for [('53f83aaa-eb53-43e9-a9df-2ff2270fd36f', None, None, None, None, None)] {{(pid=123773) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:55:11.300937 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-f14e1c97-b1e2-485e-a7a7-0db96bb9951b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Flavor limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:55:11.301364 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-f14e1c97-b1e2-485e-a7a7-0db96bb9951b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Image limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:55:11.301810 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-f14e1c97-b1e2-485e-a7a7-0db96bb9951b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Flavor pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:55:11.302242 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-f14e1c97-b1e2-485e-a7a7-0db96bb9951b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Image pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:55:11.302735 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-f14e1c97-b1e2-485e-a7a7-0db96bb9951b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:55:11.313103 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f14e1c97-b1e2-485e-a7a7-0db96bb9951b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:11.313559 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f14e1c97-b1e2-485e-a7a7-0db96bb9951b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:11.314341 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f14e1c97-b1e2-485e-a7a7-0db96bb9951b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:11.314791 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-f14e1c97-b1e2-485e-a7a7-0db96bb9951b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:11.331915 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-f14e1c97-b1e2-485e-a7a7-0db96bb9951b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Getting quotas for project 812255b0d4b24eef8288a1f27d17e501. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:55:11.336075 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-f14e1c97-b1e2-485e-a7a7-0db96bb9951b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Getting quotas for user 5f68cdcee1724e3ba14dfaf7a374f73a and project 812255b0d4b24eef8288a1f27d17e501. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:55:11.347553 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f14e1c97-b1e2-485e-a7a7-0db96bb9951b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Going to run 1 instances... {{(pid=123773) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:55:11.349887 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-f14e1c97-b1e2-485e-a7a7-0db96bb9951b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e989c938-7b7a-445c-aec9-596e81d35104',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:55:11.397997 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f14e1c97-b1e2-485e-a7a7-0db96bb9951b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [94a5feb8-cdd9-4c14-a0cc-577e8ae03694] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 16:55:12.406634 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO oslo.messaging._drivers.impl_rabbit [None req-f14e1c97-b1e2-485e-a7a7-0db96bb9951b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [94a5feb8-cdd9-4c14-a0cc-577e8ae03694] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 38280. Apr 11 16:55:12.411676 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-f14e1c97-b1e2-485e-a7a7-0db96bb9951b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.597909 Apr 11 16:55:12.412834 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 590/1153] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Apr 11 16:55:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 16:55:12.424020 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-348d1576-716d-449d-bf8d-ad3d513ab32c tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:12.424620 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-348d1576-716d-449d-bf8d-ad3d513ab32c tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:12.479911 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-348d1576-716d-449d-bf8d-ad3d513ab32c tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:12.486905 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-348d1576-716d-449d-bf8d-ad3d513ab32c tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89" status: 200 len: 1214 microversion: 2.1 time: 0.067716 Apr 11 16:55:12.487537 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 564/1154] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:12 2022] GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:13.505302 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d671edf0-cc02-44ae-b455-27217bbc099d tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:13.505866 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d671edf0-cc02-44ae-b455-27217bbc099d tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:13.559173 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d671edf0-cc02-44ae-b455-27217bbc099d tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:13.566670 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d671edf0-cc02-44ae-b455-27217bbc099d tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89" status: 200 len: 1214 microversion: 2.1 time: 0.065809 Apr 11 16:55:13.567241 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 591/1155] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:13 2022] GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:14.583710 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-80a25185-0836-4066-b0ae-6cbc980edd43 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:14.584365 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-80a25185-0836-4066-b0ae-6cbc980edd43 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:14.641082 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-80a25185-0836-4066-b0ae-6cbc980edd43 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:14.648520 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-80a25185-0836-4066-b0ae-6cbc980edd43 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89" status: 200 len: 1214 microversion: 2.1 time: 0.068611 Apr 11 16:55:14.649154 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 565/1156] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:14 2022] GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:15.666788 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-2846e24d-ec61-456d-bb59-fe83837cce71 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:15.667387 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-2846e24d-ec61-456d-bb59-fe83837cce71 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:15.724321 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-2846e24d-ec61-456d-bb59-fe83837cce71 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:15.731687 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-2846e24d-ec61-456d-bb59-fe83837cce71 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89" status: 200 len: 1214 microversion: 2.1 time: 0.068814 Apr 11 16:55:15.732509 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 592/1157] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:15 2022] GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:15.745312 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:55:15.745611 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: Mon Apr 11 16:55:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 16:55:16.749747 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-e10ab676-6c24-4ce5-a26c-f86a50059bcb tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:16.750337 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-e10ab676-6c24-4ce5-a26c-f86a50059bcb tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:16.757340 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e10ab676-6c24-4ce5-a26c-f86a50059bcb tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:16.757786 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e10ab676-6c24-4ce5-a26c-f86a50059bcb tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:16.758537 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e10ab676-6c24-4ce5-a26c-f86a50059bcb tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:16.758992 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-e10ab676-6c24-4ce5-a26c-f86a50059bcb tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:16.829242 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-e10ab676-6c24-4ce5-a26c-f86a50059bcb tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:16.837382 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-e10ab676-6c24-4ce5-a26c-f86a50059bcb tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89" status: 200 len: 1218 microversion: 2.1 time: 0.091603 Apr 11 16:55:16.837960 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 566/1158] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:16 2022] GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:17.858687 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-479003a6-386c-4eb8-b419-21e3464d5139 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:17.859295 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-479003a6-386c-4eb8-b419-21e3464d5139 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:17.866603 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-479003a6-386c-4eb8-b419-21e3464d5139 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:17.867085 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-479003a6-386c-4eb8-b419-21e3464d5139 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:17.867813 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-479003a6-386c-4eb8-b419-21e3464d5139 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:17.868266 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-479003a6-386c-4eb8-b419-21e3464d5139 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:17.930368 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-479003a6-386c-4eb8-b419-21e3464d5139 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:17.938393 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-479003a6-386c-4eb8-b419-21e3464d5139 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89" status: 200 len: 1272 microversion: 2.1 time: 0.083852 Apr 11 16:55:17.938976 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 593/1159] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:17 2022] GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89 => generated 1272 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:18.956938 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-58bd973b-4d46-4009-87ae-4c0959b35e15 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:18.957567 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-58bd973b-4d46-4009-87ae-4c0959b35e15 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:18.964934 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-58bd973b-4d46-4009-87ae-4c0959b35e15 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:18.965429 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-58bd973b-4d46-4009-87ae-4c0959b35e15 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:18.966297 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-58bd973b-4d46-4009-87ae-4c0959b35e15 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:18.966771 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-58bd973b-4d46-4009-87ae-4c0959b35e15 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:19.064520 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-c67b4488-158f-4bca-8022-6b3d3585d476 req-c86d1865-1dd4-4f23-b814-f472eeac3a84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d52b87f-a605-40f7-96c7-d2af856d9b89", "tag": "fc2fd5a6-23fe-4c46-8356-cad2cc2d0448"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:55:19.078593 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-c67b4488-158f-4bca-8022-6b3d3585d476 req-c86d1865-1dd4-4f23-b814-f472eeac3a84 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:19.079622 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-c67b4488-158f-4bca-8022-6b3d3585d476 req-c86d1865-1dd4-4f23-b814-f472eeac3a84 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:19.103973 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-c67b4488-158f-4bca-8022-6b3d3585d476 req-c86d1865-1dd4-4f23-b814-f472eeac3a84 service nova] Creating event network-changed:fc2fd5a6-23fe-4c46-8356-cad2cc2d0448 for instance 6d52b87f-a605-40f7-96c7-d2af856d9b89 on hv-cinder-83716 Apr 11 16:55:19.110933 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-c67b4488-158f-4bca-8022-6b3d3585d476 req-c86d1865-1dd4-4f23-b814-f472eeac3a84 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051077 Apr 11 16:55:19.111213 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 594/1160] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:55:19.243024 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-58bd973b-4d46-4009-87ae-4c0959b35e15 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:19.251367 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-58bd973b-4d46-4009-87ae-4c0959b35e15 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89" status: 200 len: 1314 microversion: 2.1 time: 0.298761 Apr 11 16:55:19.252013 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 567/1161] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:18 2022] GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:20.271622 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-8a1d2e38-0b8f-43ed-a053-9e9775cfe9da tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:20.272441 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-8a1d2e38-0b8f-43ed-a053-9e9775cfe9da tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:20.279650 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8a1d2e38-0b8f-43ed-a053-9e9775cfe9da tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:20.280104 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8a1d2e38-0b8f-43ed-a053-9e9775cfe9da tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:20.280864 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8a1d2e38-0b8f-43ed-a053-9e9775cfe9da tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:20.281287 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-8a1d2e38-0b8f-43ed-a053-9e9775cfe9da tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:20.424649 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-8a1d2e38-0b8f-43ed-a053-9e9775cfe9da tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:20.434442 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-8a1d2e38-0b8f-43ed-a053-9e9775cfe9da tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89" status: 200 len: 1314 microversion: 2.1 time: 0.168514 Apr 11 16:55:20.435017 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 595/1162] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:20 2022] GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:21.452481 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-12ed5753-24ac-4cb7-ac87-e7cc747fdc03 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:21.453069 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-12ed5753-24ac-4cb7-ac87-e7cc747fdc03 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:21.460087 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-12ed5753-24ac-4cb7-ac87-e7cc747fdc03 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:21.460531 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-12ed5753-24ac-4cb7-ac87-e7cc747fdc03 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:21.461309 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-12ed5753-24ac-4cb7-ac87-e7cc747fdc03 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:21.462127 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-12ed5753-24ac-4cb7-ac87-e7cc747fdc03 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:21.596446 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-12ed5753-24ac-4cb7-ac87-e7cc747fdc03 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:21.605987 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-12ed5753-24ac-4cb7-ac87-e7cc747fdc03 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89" status: 200 len: 1314 microversion: 2.1 time: 0.157489 Apr 11 16:55:21.606863 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 568/1163] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:21 2022] GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:22.624293 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c551e03c-fc85-4805-968c-c705f1af8bcc tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:22.624974 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c551e03c-fc85-4805-968c-c705f1af8bcc tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:22.631475 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c551e03c-fc85-4805-968c-c705f1af8bcc tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:22.631945 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c551e03c-fc85-4805-968c-c705f1af8bcc tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:22.632710 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c551e03c-fc85-4805-968c-c705f1af8bcc tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:22.633134 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c551e03c-fc85-4805-968c-c705f1af8bcc tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:22.696290 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:55:22.696845 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: Mon Apr 11 16:55:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 16:55:22.820361 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c551e03c-fc85-4805-968c-c705f1af8bcc tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:22.828608 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c551e03c-fc85-4805-968c-c705f1af8bcc tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89" status: 200 len: 1314 microversion: 2.1 time: 0.208183 Apr 11 16:55:22.829387 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 596/1164] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:22 2022] GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:23.845901 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a722e980-bb23-4c83-9752-7d3b4ae1e7d4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:23.846649 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a722e980-bb23-4c83-9752-7d3b4ae1e7d4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:23.854092 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a722e980-bb23-4c83-9752-7d3b4ae1e7d4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:23.854532 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a722e980-bb23-4c83-9752-7d3b4ae1e7d4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:23.855297 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a722e980-bb23-4c83-9752-7d3b4ae1e7d4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:23.855751 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a722e980-bb23-4c83-9752-7d3b4ae1e7d4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:23.994700 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a722e980-bb23-4c83-9752-7d3b4ae1e7d4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:24.007703 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a722e980-bb23-4c83-9752-7d3b4ae1e7d4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89" status: 200 len: 1314 microversion: 2.1 time: 0.165400 Apr 11 16:55:24.008627 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 569/1165] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:23 2022] GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:24.875920 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-d8dae081-2da4-4f20-b089-6c59e062752b req-c7e961d5-d275-4292-a0ed-a741d820aec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d52b87f-a605-40f7-96c7-d2af856d9b89", "name": "network-vif-plugged", "status": "completed", "tag": "fc2fd5a6-23fe-4c46-8356-cad2cc2d0448"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:55:24.884607 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-d8dae081-2da4-4f20-b089-6c59e062752b req-c7e961d5-d275-4292-a0ed-a741d820aec6 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:24.884937 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-d8dae081-2da4-4f20-b089-6c59e062752b req-c7e961d5-d275-4292-a0ed-a741d820aec6 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:24.896465 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-d8dae081-2da4-4f20-b089-6c59e062752b req-c7e961d5-d275-4292-a0ed-a741d820aec6 service nova] Creating event network-vif-plugged:fc2fd5a6-23fe-4c46-8356-cad2cc2d0448 for instance 6d52b87f-a605-40f7-96c7-d2af856d9b89 on hv-cinder-83716 Apr 11 16:55:24.901611 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-d8dae081-2da4-4f20-b089-6c59e062752b req-c7e961d5-d275-4292-a0ed-a741d820aec6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098299 Apr 11 16:55:24.902452 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 597/1166] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:55:25.026332 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-49f6ba7e-30da-4f08-ba9f-0dfa6f9ab69e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:25.026952 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-49f6ba7e-30da-4f08-ba9f-0dfa6f9ab69e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:25.034209 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-49f6ba7e-30da-4f08-ba9f-0dfa6f9ab69e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:25.034747 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-49f6ba7e-30da-4f08-ba9f-0dfa6f9ab69e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:25.035517 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-49f6ba7e-30da-4f08-ba9f-0dfa6f9ab69e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:25.036008 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-49f6ba7e-30da-4f08-ba9f-0dfa6f9ab69e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:25.173459 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-49f6ba7e-30da-4f08-ba9f-0dfa6f9ab69e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:25.181281 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-49f6ba7e-30da-4f08-ba9f-0dfa6f9ab69e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89" status: 200 len: 1314 microversion: 2.1 time: 0.159154 Apr 11 16:55:25.182182 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 570/1167] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:25 2022] GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:26.200040 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-7b62c12e-332d-42b3-84b2-e567ca853592 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:26.200625 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-7b62c12e-332d-42b3-84b2-e567ca853592 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:26.207534 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7b62c12e-332d-42b3-84b2-e567ca853592 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:26.208012 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7b62c12e-332d-42b3-84b2-e567ca853592 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:26.208804 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7b62c12e-332d-42b3-84b2-e567ca853592 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:26.209237 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-7b62c12e-332d-42b3-84b2-e567ca853592 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:26.361187 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-7b62c12e-332d-42b3-84b2-e567ca853592 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:26.369115 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-7b62c12e-332d-42b3-84b2-e567ca853592 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89" status: 200 len: 1314 microversion: 2.1 time: 0.174137 Apr 11 16:55:26.369683 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 598/1168] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:26 2022] GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:27.386994 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5e3f98e2-8208-4e1b-adf5-8873789cd3d4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:27.387736 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5e3f98e2-8208-4e1b-adf5-8873789cd3d4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:27.394600 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5e3f98e2-8208-4e1b-adf5-8873789cd3d4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:27.395041 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5e3f98e2-8208-4e1b-adf5-8873789cd3d4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:27.395867 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5e3f98e2-8208-4e1b-adf5-8873789cd3d4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:27.396298 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5e3f98e2-8208-4e1b-adf5-8873789cd3d4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:27.535798 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5e3f98e2-8208-4e1b-adf5-8873789cd3d4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:27.543908 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5e3f98e2-8208-4e1b-adf5-8873789cd3d4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89" status: 200 len: 1498 microversion: 2.1 time: 0.161407 Apr 11 16:55:27.544514 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 571/1169] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:27 2022] GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89 => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:27.951673 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-816f348e-2bfc-430b-869b-157c0327b778 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:27.952289 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-816f348e-2bfc-430b-869b-157c0327b778 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:27.958825 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-816f348e-2bfc-430b-869b-157c0327b778 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:27.959266 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-816f348e-2bfc-430b-869b-157c0327b778 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:27.960099 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-816f348e-2bfc-430b-869b-157c0327b778 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:27.960523 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-816f348e-2bfc-430b-869b-157c0327b778 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:27.989540 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-816f348e-2bfc-430b-869b-157c0327b778 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] Going to try to terminate instance {{(pid=123773) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:55:28.080810 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-816f348e-2bfc-430b-869b-157c0327b778 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89" status: 204 len: 0 microversion: 2.1 time: 0.132582 Apr 11 16:55:28.081425 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 599/1170] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:55:27 2022] DELETE /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:55:28.092279 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-a8241b53-7118-47f0-be5b-e6f27298d89e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:28.093246 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-a8241b53-7118-47f0-be5b-e6f27298d89e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:28.100310 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a8241b53-7118-47f0-be5b-e6f27298d89e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:28.100760 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a8241b53-7118-47f0-be5b-e6f27298d89e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:28.101545 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a8241b53-7118-47f0-be5b-e6f27298d89e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:28.101983 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-a8241b53-7118-47f0-be5b-e6f27298d89e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:28.251586 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-a8241b53-7118-47f0-be5b-e6f27298d89e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:28.260046 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-a8241b53-7118-47f0-be5b-e6f27298d89e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89" status: 200 len: 1504 microversion: 2.1 time: 0.172689 Apr 11 16:55:28.260768 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 572/1171] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:28 2022] GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:29.280096 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-07442c79-35c0-4c66-849b-f0ecdc0140eb tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:29.281447 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-07442c79-35c0-4c66-849b-f0ecdc0140eb tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:29.289908 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-07442c79-35c0-4c66-849b-f0ecdc0140eb tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:29.290459 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-07442c79-35c0-4c66-849b-f0ecdc0140eb tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:29.291929 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-07442c79-35c0-4c66-849b-f0ecdc0140eb tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:29.292707 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-07442c79-35c0-4c66-849b-f0ecdc0140eb tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:29.472796 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-07442c79-35c0-4c66-849b-f0ecdc0140eb tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:29.484287 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-07442c79-35c0-4c66-849b-f0ecdc0140eb tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89" status: 200 len: 1504 microversion: 2.1 time: 0.209198 Apr 11 16:55:29.485239 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 600/1172] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:29 2022] GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89 => generated 1504 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:30.380049 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-6b2fe1f5-7d2b-4537-8f17-25763cdc644b req-eb70ae02-9fb5-4bd7-90d4-fb9dc9467ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d52b87f-a605-40f7-96c7-d2af856d9b89", "name": "network-vif-deleted", "tag": "fc2fd5a6-23fe-4c46-8356-cad2cc2d0448"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:55:30.389471 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-6b2fe1f5-7d2b-4537-8f17-25763cdc644b req-eb70ae02-9fb5-4bd7-90d4-fb9dc9467ae4 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:30.389934 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-6b2fe1f5-7d2b-4537-8f17-25763cdc644b req-eb70ae02-9fb5-4bd7-90d4-fb9dc9467ae4 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:30.402811 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-6b2fe1f5-7d2b-4537-8f17-25763cdc644b req-eb70ae02-9fb5-4bd7-90d4-fb9dc9467ae4 service nova] Creating event network-vif-deleted:fc2fd5a6-23fe-4c46-8356-cad2cc2d0448 for instance 6d52b87f-a605-40f7-96c7-d2af856d9b89 on hv-cinder-83716 Apr 11 16:55:30.408681 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-6b2fe1f5-7d2b-4537-8f17-25763cdc644b req-eb70ae02-9fb5-4bd7-90d4-fb9dc9467ae4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032589 Apr 11 16:55:30.409498 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 573/1173] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:55:30.505860 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1dd15dab-2b02-4149-aded-10eb43e0e99e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:30.506738 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1dd15dab-2b02-4149-aded-10eb43e0e99e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:30.515737 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1dd15dab-2b02-4149-aded-10eb43e0e99e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:30.516778 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1dd15dab-2b02-4149-aded-10eb43e0e99e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:30.517906 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1dd15dab-2b02-4149-aded-10eb43e0e99e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:30.518508 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1dd15dab-2b02-4149-aded-10eb43e0e99e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:30.558411 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1dd15dab-2b02-4149-aded-10eb43e0e99e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:30.558854 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1dd15dab-2b02-4149-aded-10eb43e0e99e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:30.559290 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.objects.instance [None req-1dd15dab-2b02-4149-aded-10eb43e0e99e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lazy-loading 'fault' on Instance uuid 6d52b87f-a605-40f7-96c7-d2af856d9b89 {{(pid=123773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:55:30.603795 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1dd15dab-2b02-4149-aded-10eb43e0e99e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:30.611795 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1dd15dab-2b02-4149-aded-10eb43e0e99e tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89" status: 200 len: 1304 microversion: 2.1 time: 0.110716 Apr 11 16:55:30.612402 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 601/1174] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:30 2022] GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:31.630433 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c469812b-6d98-4a7f-9f92-813d4e3f6b0c tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:31.631100 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c469812b-6d98-4a7f-9f92-813d4e3f6b0c tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: 6d52b87f-a605-40f7-96c7-d2af856d9b89] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:31.638427 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c469812b-6d98-4a7f-9f92-813d4e3f6b0c tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:31.638871 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c469812b-6d98-4a7f-9f92-813d4e3f6b0c tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:31.639708 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c469812b-6d98-4a7f-9f92-813d4e3f6b0c tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:31.640171 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c469812b-6d98-4a7f-9f92-813d4e3f6b0c tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:31.656580 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-c469812b-6d98-4a7f-9f92-813d4e3f6b0c tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] HTTP exception thrown: Instance 6d52b87f-a605-40f7-96c7-d2af856d9b89 could not be found. Apr 11 16:55:31.657176 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c469812b-6d98-4a7f-9f92-813d4e3f6b0c tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Returning 404 to user: Instance 6d52b87f-a605-40f7-96c7-d2af856d9b89 could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:55:31.658014 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c469812b-6d98-4a7f-9f92-813d4e3f6b0c tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89" status: 404 len: 111 microversion: 2.1 time: 0.031943 Apr 11 16:55:31.658596 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 574/1175] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:31 2022] GET /compute/v2.1/servers/6d52b87f-a605-40f7-96c7-d2af856d9b89 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:55:31.715077 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-e18d0617-913b-4698-a60a-3cb0cbfc28ec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1316488798", "imageRef": "e989c938-7b7a-445c-aec9-596e81d35104", "flavorRef": "452", "networks": [{"uuid": "53f83aaa-eb53-43e9-a9df-2ff2270fd36f"}]}} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:55:31.781074 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.network.neutron [None req-e18d0617-913b-4698-a60a-3cb0cbfc28ec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] validate_networks() for [('53f83aaa-eb53-43e9-a9df-2ff2270fd36f', None, None, None, None, None)] {{(pid=123773) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:55:32.195290 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-e18d0617-913b-4698-a60a-3cb0cbfc28ec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Flavor limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:55:32.196033 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-e18d0617-913b-4698-a60a-3cb0cbfc28ec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Image limits 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:55:32.197445 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-e18d0617-913b-4698-a60a-3cb0cbfc28ec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Flavor pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:55:32.198168 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-e18d0617-913b-4698-a60a-3cb0cbfc28ec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Image pref 0:0:0 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:55:32.198904 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.virt.hardware [None req-e18d0617-913b-4698-a60a-3cb0cbfc28ec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:55:32.214290 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e18d0617-913b-4698-a60a-3cb0cbfc28ec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:32.215063 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e18d0617-913b-4698-a60a-3cb0cbfc28ec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:32.216468 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e18d0617-913b-4698-a60a-3cb0cbfc28ec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:32.217189 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-e18d0617-913b-4698-a60a-3cb0cbfc28ec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:32.247063 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-e18d0617-913b-4698-a60a-3cb0cbfc28ec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Getting quotas for project 812255b0d4b24eef8288a1f27d17e501. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:55:32.251855 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.quota [None req-e18d0617-913b-4698-a60a-3cb0cbfc28ec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Getting quotas for user 5f68cdcee1724e3ba14dfaf7a374f73a and project 812255b0d4b24eef8288a1f27d17e501. Resources: {'instances', 'ram', 'cores'} {{(pid=123773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:55:32.265494 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-e18d0617-913b-4698-a60a-3cb0cbfc28ec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Going to run 1 instances... {{(pid=123773) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:55:32.268086 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-e18d0617-913b-4698-a60a-3cb0cbfc28ec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: ef229e07-94b5-4db0-824e-748bbb14aaeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e989c938-7b7a-445c-aec9-596e81d35104',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:55:32.318576 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-e18d0617-913b-4698-a60a-3cb0cbfc28ec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611747 Apr 11 16:55:32.319232 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 602/1176] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Apr 11 16:55:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 16:55:32.334830 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-8d99fd03-879a-4f3f-b969-fe47ac0889be tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:32.336098 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-8d99fd03-879a-4f3f-b969-fe47ac0889be tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: ef229e07-94b5-4db0-824e-748bbb14aaeb] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:32.406750 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-8d99fd03-879a-4f3f-b969-fe47ac0889be tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:32.413733 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-8d99fd03-879a-4f3f-b969-fe47ac0889be tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb" status: 200 len: 1214 microversion: 2.1 time: 0.086475 Apr 11 16:55:32.414330 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 575/1177] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:32 2022] GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 16:55:33.431299 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-157472ee-15f6-4463-88fe-477d1975c408 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:33.431940 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-157472ee-15f6-4463-88fe-477d1975c408 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: ef229e07-94b5-4db0-824e-748bbb14aaeb] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:33.438264 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-157472ee-15f6-4463-88fe-477d1975c408 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:33.438825 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-157472ee-15f6-4463-88fe-477d1975c408 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:33.439479 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-157472ee-15f6-4463-88fe-477d1975c408 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:33.439941 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-157472ee-15f6-4463-88fe-477d1975c408 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:33.529765 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-157472ee-15f6-4463-88fe-477d1975c408 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:33.538785 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-157472ee-15f6-4463-88fe-477d1975c408 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb" status: 200 len: 1272 microversion: 2.1 time: 0.111756 Apr 11 16:55:33.539372 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 603/1178] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:33 2022] GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb => generated 1272 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:34.561760 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-d8a72a02-acc0-4a73-90d3-4751d1277eae tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:34.562395 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-d8a72a02-acc0-4a73-90d3-4751d1277eae tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: ef229e07-94b5-4db0-824e-748bbb14aaeb] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:34.569873 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d8a72a02-acc0-4a73-90d3-4751d1277eae tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:34.570348 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d8a72a02-acc0-4a73-90d3-4751d1277eae tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:34.571124 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d8a72a02-acc0-4a73-90d3-4751d1277eae tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:34.571721 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-d8a72a02-acc0-4a73-90d3-4751d1277eae tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:34.661315 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-ece0bbb4-2f1c-4c2b-8c47-0703da071c34 req-730fc930-1556-4a10-8cb3-259326621eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef229e07-94b5-4db0-824e-748bbb14aaeb", "tag": "10d4a880-3381-4361-a600-fe5a968808c1"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:55:34.674323 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-ece0bbb4-2f1c-4c2b-8c47-0703da071c34 req-730fc930-1556-4a10-8cb3-259326621eb8 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:34.675234 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-ece0bbb4-2f1c-4c2b-8c47-0703da071c34 req-730fc930-1556-4a10-8cb3-259326621eb8 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:34.692062 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-ece0bbb4-2f1c-4c2b-8c47-0703da071c34 req-730fc930-1556-4a10-8cb3-259326621eb8 service nova] Creating event network-changed:10d4a880-3381-4361-a600-fe5a968808c1 for instance ef229e07-94b5-4db0-824e-748bbb14aaeb on hv-cinder-83716 Apr 11 16:55:34.699578 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-ece0bbb4-2f1c-4c2b-8c47-0703da071c34 req-730fc930-1556-4a10-8cb3-259326621eb8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043605 Apr 11 16:55:34.701070 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 604/1179] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:55:34.713969 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-d8a72a02-acc0-4a73-90d3-4751d1277eae tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:34.722225 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-d8a72a02-acc0-4a73-90d3-4751d1277eae tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb" status: 200 len: 1314 microversion: 2.1 time: 0.164360 Apr 11 16:55:34.722812 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 576/1180] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:34 2022] GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:35.744165 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-26b4ef3c-e9f1-4896-b41f-ad61a22cb6af tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:35.744850 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-26b4ef3c-e9f1-4896-b41f-ad61a22cb6af tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: ef229e07-94b5-4db0-824e-748bbb14aaeb] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:35.751345 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-26b4ef3c-e9f1-4896-b41f-ad61a22cb6af tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:35.751918 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-26b4ef3c-e9f1-4896-b41f-ad61a22cb6af tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:35.752606 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-26b4ef3c-e9f1-4896-b41f-ad61a22cb6af tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:35.753038 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-26b4ef3c-e9f1-4896-b41f-ad61a22cb6af tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:35.886736 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-26b4ef3c-e9f1-4896-b41f-ad61a22cb6af tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:35.896731 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-26b4ef3c-e9f1-4896-b41f-ad61a22cb6af tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb" status: 200 len: 1314 microversion: 2.1 time: 0.158724 Apr 11 16:55:35.897420 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 605/1181] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:35 2022] GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:36.917311 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-bcc59224-a51c-4c07-86e2-109e89897679 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:36.917983 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-bcc59224-a51c-4c07-86e2-109e89897679 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: ef229e07-94b5-4db0-824e-748bbb14aaeb] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:36.924539 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bcc59224-a51c-4c07-86e2-109e89897679 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:36.925264 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bcc59224-a51c-4c07-86e2-109e89897679 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:36.925736 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bcc59224-a51c-4c07-86e2-109e89897679 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:36.926158 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-bcc59224-a51c-4c07-86e2-109e89897679 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:37.063271 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-bcc59224-a51c-4c07-86e2-109e89897679 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:37.071232 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-bcc59224-a51c-4c07-86e2-109e89897679 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb" status: 200 len: 1314 microversion: 2.1 time: 0.159745 Apr 11 16:55:37.071894 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 577/1182] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:36 2022] GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:38.089389 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-76f26ff7-c5a3-4d13-836d-d24a0741e4b4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:38.089970 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-76f26ff7-c5a3-4d13-836d-d24a0741e4b4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: ef229e07-94b5-4db0-824e-748bbb14aaeb] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:38.096863 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-76f26ff7-c5a3-4d13-836d-d24a0741e4b4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:38.097298 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-76f26ff7-c5a3-4d13-836d-d24a0741e4b4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:38.098095 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-76f26ff7-c5a3-4d13-836d-d24a0741e4b4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:38.098620 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-76f26ff7-c5a3-4d13-836d-d24a0741e4b4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:38.238811 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-76f26ff7-c5a3-4d13-836d-d24a0741e4b4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:38.247142 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-76f26ff7-c5a3-4d13-836d-d24a0741e4b4 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb" status: 200 len: 1314 microversion: 2.1 time: 0.161696 Apr 11 16:55:38.247836 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 606/1183] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:38 2022] GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:39.264900 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-2e1a9e0a-3372-4dcc-a894-dd037646b820 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:39.265559 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-2e1a9e0a-3372-4dcc-a894-dd037646b820 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: ef229e07-94b5-4db0-824e-748bbb14aaeb] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:39.273727 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2e1a9e0a-3372-4dcc-a894-dd037646b820 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:39.274256 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2e1a9e0a-3372-4dcc-a894-dd037646b820 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:39.275330 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2e1a9e0a-3372-4dcc-a894-dd037646b820 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:39.276039 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-2e1a9e0a-3372-4dcc-a894-dd037646b820 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:39.417833 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-2e1a9e0a-3372-4dcc-a894-dd037646b820 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:39.426565 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-2e1a9e0a-3372-4dcc-a894-dd037646b820 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb" status: 200 len: 1314 microversion: 2.1 time: 0.165776 Apr 11 16:55:39.427159 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 578/1184] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:39 2022] GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:40.444677 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-9cff76b3-a755-44e5-ab32-3beeb9ff0eec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:40.445256 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-9cff76b3-a755-44e5-ab32-3beeb9ff0eec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: ef229e07-94b5-4db0-824e-748bbb14aaeb] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:40.452378 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9cff76b3-a755-44e5-ab32-3beeb9ff0eec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:40.452827 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9cff76b3-a755-44e5-ab32-3beeb9ff0eec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:40.453586 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9cff76b3-a755-44e5-ab32-3beeb9ff0eec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:40.454041 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9cff76b3-a755-44e5-ab32-3beeb9ff0eec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:40.605215 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9cff76b3-a755-44e5-ab32-3beeb9ff0eec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:40.613446 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-9cff76b3-a755-44e5-ab32-3beeb9ff0eec tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb" status: 200 len: 1314 microversion: 2.1 time: 0.172755 Apr 11 16:55:40.614028 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 607/1185] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:40 2022] GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:40.882849 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-faf7681b-845e-4c37-95ad-4eebb8f9f3e3 req-8a3a5e12-86dd-4bbf-8860-f955b7875946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef229e07-94b5-4db0-824e-748bbb14aaeb", "name": "network-vif-plugged", "status": "completed", "tag": "10d4a880-3381-4361-a600-fe5a968808c1"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:55:40.893164 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-faf7681b-845e-4c37-95ad-4eebb8f9f3e3 req-8a3a5e12-86dd-4bbf-8860-f955b7875946 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:40.894001 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-faf7681b-845e-4c37-95ad-4eebb8f9f3e3 req-8a3a5e12-86dd-4bbf-8860-f955b7875946 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:40.907061 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-faf7681b-845e-4c37-95ad-4eebb8f9f3e3 req-8a3a5e12-86dd-4bbf-8860-f955b7875946 service nova] Creating event network-vif-plugged:10d4a880-3381-4361-a600-fe5a968808c1 for instance ef229e07-94b5-4db0-824e-748bbb14aaeb on hv-cinder-83716 Apr 11 16:55:40.912103 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-faf7681b-845e-4c37-95ad-4eebb8f9f3e3 req-8a3a5e12-86dd-4bbf-8860-f955b7875946 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033196 Apr 11 16:55:40.912775 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 579/1186] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:55:41.633538 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-d8a79f85-d439-4c4a-91af-9031a158f294 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:41.634355 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-d8a79f85-d439-4c4a-91af-9031a158f294 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: ef229e07-94b5-4db0-824e-748bbb14aaeb] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:41.643435 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d8a79f85-d439-4c4a-91af-9031a158f294 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:41.644067 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d8a79f85-d439-4c4a-91af-9031a158f294 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:41.645078 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d8a79f85-d439-4c4a-91af-9031a158f294 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:41.645648 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-d8a79f85-d439-4c4a-91af-9031a158f294 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:41.787667 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-d8a79f85-d439-4c4a-91af-9031a158f294 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:41.796151 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-d8a79f85-d439-4c4a-91af-9031a158f294 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb" status: 200 len: 1314 microversion: 2.1 time: 0.167845 Apr 11 16:55:41.796726 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 608/1187] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:41 2022] GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:42.818227 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-baf12f42-0231-41b7-a130-a0a4c3f15908 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:42.818863 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-baf12f42-0231-41b7-a130-a0a4c3f15908 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: ef229e07-94b5-4db0-824e-748bbb14aaeb] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:42.827294 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-baf12f42-0231-41b7-a130-a0a4c3f15908 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:42.827767 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-baf12f42-0231-41b7-a130-a0a4c3f15908 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:42.828538 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-baf12f42-0231-41b7-a130-a0a4c3f15908 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:42.828969 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-baf12f42-0231-41b7-a130-a0a4c3f15908 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:42.973621 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-baf12f42-0231-41b7-a130-a0a4c3f15908 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:42.981937 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-baf12f42-0231-41b7-a130-a0a4c3f15908 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb" status: 200 len: 1314 microversion: 2.1 time: 0.170978 Apr 11 16:55:42.982523 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 580/1188] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:42 2022] GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:43.999472 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-1a306f47-bf53-4ecd-919e-dbd2dd37d6aa tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:44.000135 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-1a306f47-bf53-4ecd-919e-dbd2dd37d6aa tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: ef229e07-94b5-4db0-824e-748bbb14aaeb] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:44.009105 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1a306f47-bf53-4ecd-919e-dbd2dd37d6aa tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:44.009553 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1a306f47-bf53-4ecd-919e-dbd2dd37d6aa tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:44.010689 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1a306f47-bf53-4ecd-919e-dbd2dd37d6aa tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:44.011123 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-1a306f47-bf53-4ecd-919e-dbd2dd37d6aa tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:44.162563 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-1a306f47-bf53-4ecd-919e-dbd2dd37d6aa tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:44.171106 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-1a306f47-bf53-4ecd-919e-dbd2dd37d6aa tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb" status: 200 len: 1498 microversion: 2.1 time: 0.175758 Apr 11 16:55:44.171692 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 609/1189] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:43 2022] GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb => generated 1498 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:44.619058 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-631fa6dd-9541-4192-a27a-bbfad240bac8 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:44.619604 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-631fa6dd-9541-4192-a27a-bbfad240bac8 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: ef229e07-94b5-4db0-824e-748bbb14aaeb] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:44.626815 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-631fa6dd-9541-4192-a27a-bbfad240bac8 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:44.627262 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-631fa6dd-9541-4192-a27a-bbfad240bac8 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:44.628065 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-631fa6dd-9541-4192-a27a-bbfad240bac8 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:44.628487 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-631fa6dd-9541-4192-a27a-bbfad240bac8 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:44.654670 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-631fa6dd-9541-4192-a27a-bbfad240bac8 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: ef229e07-94b5-4db0-824e-748bbb14aaeb] Going to try to terminate instance {{(pid=123774) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:55:44.742963 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-631fa6dd-9541-4192-a27a-bbfad240bac8 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb" status: 204 len: 0 microversion: 2.1 time: 0.127139 Apr 11 16:55:44.744083 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 581/1190] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:55:44 2022] DELETE /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:55:44.753795 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c381394d-1523-4766-9571-bd82963cae9b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:44.754414 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c381394d-1523-4766-9571-bd82963cae9b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: ef229e07-94b5-4db0-824e-748bbb14aaeb] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:44.760532 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c381394d-1523-4766-9571-bd82963cae9b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:44.760954 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c381394d-1523-4766-9571-bd82963cae9b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:44.761726 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c381394d-1523-4766-9571-bd82963cae9b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:44.762145 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c381394d-1523-4766-9571-bd82963cae9b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:44.894399 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c381394d-1523-4766-9571-bd82963cae9b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:44.905513 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c381394d-1523-4766-9571-bd82963cae9b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb" status: 200 len: 1504 microversion: 2.1 time: 0.155673 Apr 11 16:55:44.906350 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 610/1191] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:44 2022] GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:45.929075 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-0e3d5479-67fa-480a-a64b-004d5da59f09 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:45.929755 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-0e3d5479-67fa-480a-a64b-004d5da59f09 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: ef229e07-94b5-4db0-824e-748bbb14aaeb] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:45.936874 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0e3d5479-67fa-480a-a64b-004d5da59f09 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:45.937355 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0e3d5479-67fa-480a-a64b-004d5da59f09 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:45.938126 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0e3d5479-67fa-480a-a64b-004d5da59f09 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:45.938556 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-0e3d5479-67fa-480a-a64b-004d5da59f09 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:46.074067 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-0e3d5479-67fa-480a-a64b-004d5da59f09 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:46.084789 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-0e3d5479-67fa-480a-a64b-004d5da59f09 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb" status: 200 len: 1504 microversion: 2.1 time: 0.160023 Apr 11 16:55:46.085382 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 582/1192] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:45 2022] GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:46.882502 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-28e2b262-6b7f-4919-867d-ca2c1ce939fd req-674706da-92ed-480f-95bf-154a2f109fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef229e07-94b5-4db0-824e-748bbb14aaeb", "name": "network-vif-deleted", "tag": "10d4a880-3381-4361-a600-fe5a968808c1"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:55:46.893669 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-28e2b262-6b7f-4919-867d-ca2c1ce939fd req-674706da-92ed-480f-95bf-154a2f109fd6 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:46.894314 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-28e2b262-6b7f-4919-867d-ca2c1ce939fd req-674706da-92ed-480f-95bf-154a2f109fd6 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:46.907604 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-28e2b262-6b7f-4919-867d-ca2c1ce939fd req-674706da-92ed-480f-95bf-154a2f109fd6 service nova] Creating event network-vif-deleted:10d4a880-3381-4361-a600-fe5a968808c1 for instance ef229e07-94b5-4db0-824e-748bbb14aaeb on hv-cinder-83716 Apr 11 16:55:46.913896 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-28e2b262-6b7f-4919-867d-ca2c1ce939fd req-674706da-92ed-480f-95bf-154a2f109fd6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035263 Apr 11 16:55:46.914567 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 611/1193] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:55:47.109715 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-91e0e65e-5030-4705-9500-1f93ea703b9b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:47.110456 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-91e0e65e-5030-4705-9500-1f93ea703b9b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: ef229e07-94b5-4db0-824e-748bbb14aaeb] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:47.118055 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-91e0e65e-5030-4705-9500-1f93ea703b9b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:47.118725 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-91e0e65e-5030-4705-9500-1f93ea703b9b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:47.120017 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-91e0e65e-5030-4705-9500-1f93ea703b9b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:47.120600 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-91e0e65e-5030-4705-9500-1f93ea703b9b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:47.157212 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-91e0e65e-5030-4705-9500-1f93ea703b9b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:47.157652 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-91e0e65e-5030-4705-9500-1f93ea703b9b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:47.158101 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.objects.instance [None req-91e0e65e-5030-4705-9500-1f93ea703b9b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lazy-loading 'fault' on Instance uuid ef229e07-94b5-4db0-824e-748bbb14aaeb {{(pid=123774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:55:47.198167 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-91e0e65e-5030-4705-9500-1f93ea703b9b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f68cdcee1724e3ba14dfaf7a374f73a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812255b0d4b24eef8288a1f27d17e501', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:55:47.207145 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-91e0e65e-5030-4705-9500-1f93ea703b9b tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb" status: 200 len: 1304 microversion: 2.1 time: 0.101676 Apr 11 16:55:47.207765 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 583/1194] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:47 2022] GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:55:48.226468 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-6288653b-8122-4093-8661-11ecfd160514 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:55:48.227109 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-6288653b-8122-4093-8661-11ecfd160514 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] [instance: ef229e07-94b5-4db0-824e-748bbb14aaeb] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:55:48.234699 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6288653b-8122-4093-8661-11ecfd160514 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:48.235139 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6288653b-8122-4093-8661-11ecfd160514 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:48.235949 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6288653b-8122-4093-8661-11ecfd160514 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:55:48.236371 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-6288653b-8122-4093-8661-11ecfd160514 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:55:48.251026 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.wsgi [None req-6288653b-8122-4093-8661-11ecfd160514 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] HTTP exception thrown: Instance ef229e07-94b5-4db0-824e-748bbb14aaeb could not be found. Apr 11 16:55:48.251606 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-6288653b-8122-4093-8661-11ecfd160514 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] Returning 404 to user: Instance ef229e07-94b5-4db0-824e-748bbb14aaeb could not be found. {{(pid=123773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:55:48.252504 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-6288653b-8122-4093-8661-11ecfd160514 tempest-VolumesActionsTest-959069915 tempest-VolumesActionsTest-959069915-project] 10.222.0.65 "GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb" status: 404 len: 111 microversion: 2.1 time: 0.030886 Apr 11 16:55:48.253056 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 612/1195] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:55:48 2022] GET /compute/v2.1/servers/ef229e07-94b5-4db0-824e-748bbb14aaeb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:56:14.349936 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-c4bc211f-5694-4bbf-9765-f24043a57fd6 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-322224472", "imageRef": "e989c938-7b7a-445c-aec9-596e81d35104", "flavorRef": "452"}} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:56:14.404286 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.network.neutron [None req-c4bc211f-5694-4bbf-9765-f24043a57fd6 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] validate_networks() for None {{(pid=123774) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 11 16:56:14.694229 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-c4bc211f-5694-4bbf-9765-f24043a57fd6 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Flavor limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 16:56:14.694797 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-c4bc211f-5694-4bbf-9765-f24043a57fd6 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Image limits 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 16:56:14.695436 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-c4bc211f-5694-4bbf-9765-f24043a57fd6 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Flavor pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 16:56:14.695964 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-c4bc211f-5694-4bbf-9765-f24043a57fd6 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Image pref 0:0:0 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 16:56:14.696489 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.virt.hardware [None req-c4bc211f-5694-4bbf-9765-f24043a57fd6 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 16:56:14.707971 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c4bc211f-5694-4bbf-9765-f24043a57fd6 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:14.708409 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c4bc211f-5694-4bbf-9765-f24043a57fd6 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:14.709210 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c4bc211f-5694-4bbf-9765-f24043a57fd6 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:14.709639 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-c4bc211f-5694-4bbf-9765-f24043a57fd6 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:14.727746 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-c4bc211f-5694-4bbf-9765-f24043a57fd6 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Getting quotas for project ac121a20bdfd4551be0c313096ce78a6. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 16:56:14.732287 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.quota [None req-c4bc211f-5694-4bbf-9765-f24043a57fd6 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Getting quotas for user e023bd176fc74b82b9899734d604760c and project ac121a20bdfd4551be0c313096ce78a6. Resources: {'instances', 'ram', 'cores'} {{(pid=123774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 16:56:14.744402 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c4bc211f-5694-4bbf-9765-f24043a57fd6 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Going to run 1 instances... {{(pid=123774) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 11 16:56:14.746723 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-c4bc211f-5694-4bbf-9765-f24043a57fd6 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] [instance: 2da52462-039d-49aa-87d9-937177392f44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e989c938-7b7a-445c-aec9-596e81d35104',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 11 16:56:14.796977 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-c4bc211f-5694-4bbf-9765-f24043a57fd6 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.451436 Apr 11 16:56:14.797605 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 584/1196] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Apr 11 16:56:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 16:56:14.808171 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-6aa05b98-c38e-4d7f-858a-4e0a1409abf7 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:56:14.808752 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-6aa05b98-c38e-4d7f-858a-4e0a1409abf7 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] [instance: 2da52462-039d-49aa-87d9-937177392f44] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:56:14.864267 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-6aa05b98-c38e-4d7f-858a-4e0a1409abf7 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023bd176fc74b82b9899734d604760c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac121a20bdfd4551be0c313096ce78a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:56:14.871370 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-6aa05b98-c38e-4d7f-858a-4e0a1409abf7 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] 10.222.0.65 "GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44" status: 200 len: 1214 microversion: 2.1 time: 0.067164 Apr 11 16:56:14.871983 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 613/1197] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:56:14 2022] GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:56:15.889531 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-08565776-cc6a-441b-84c8-86f2191f617e tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:56:15.890149 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-08565776-cc6a-441b-84c8-86f2191f617e tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] [instance: 2da52462-039d-49aa-87d9-937177392f44] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:56:15.896748 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-08565776-cc6a-441b-84c8-86f2191f617e tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:15.897185 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-08565776-cc6a-441b-84c8-86f2191f617e tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:15.897958 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-08565776-cc6a-441b-84c8-86f2191f617e tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:15.898384 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-08565776-cc6a-441b-84c8-86f2191f617e tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:16.252108 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-08565776-cc6a-441b-84c8-86f2191f617e tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023bd176fc74b82b9899734d604760c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac121a20bdfd4551be0c313096ce78a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:56:16.260546 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-08565776-cc6a-441b-84c8-86f2191f617e tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] 10.222.0.65 "GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44" status: 200 len: 1272 microversion: 2.1 time: 0.375575 Apr 11 16:56:16.261221 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 585/1198] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:56:15 2022] GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44 => generated 1272 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:56:17.278377 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-2e41865f-534e-40eb-ae25-5c22d4c6b04a tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:56:17.279010 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-2e41865f-534e-40eb-ae25-5c22d4c6b04a tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] [instance: 2da52462-039d-49aa-87d9-937177392f44] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:56:17.286607 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2e41865f-534e-40eb-ae25-5c22d4c6b04a tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:17.287052 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2e41865f-534e-40eb-ae25-5c22d4c6b04a tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:17.287929 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2e41865f-534e-40eb-ae25-5c22d4c6b04a tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:17.288380 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2e41865f-534e-40eb-ae25-5c22d4c6b04a tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:17.438431 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-2e41865f-534e-40eb-ae25-5c22d4c6b04a tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023bd176fc74b82b9899734d604760c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac121a20bdfd4551be0c313096ce78a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:56:17.447317 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-2e41865f-534e-40eb-ae25-5c22d4c6b04a tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] 10.222.0.65 "GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44" status: 200 len: 1314 microversion: 2.1 time: 0.172421 Apr 11 16:56:17.448153 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 614/1199] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:56:17 2022] GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:56:17.602196 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-8da5c026-8be5-46b7-9708-b581b181987c req-3c7cf824-a5e2-4737-a18d-c1aa5a44aa06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2da52462-039d-49aa-87d9-937177392f44", "tag": "923bbc6f-4f36-4f49-afad-b19ee3bebba7"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:56:17.628348 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-8da5c026-8be5-46b7-9708-b581b181987c req-3c7cf824-a5e2-4737-a18d-c1aa5a44aa06 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:17.629210 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-8da5c026-8be5-46b7-9708-b581b181987c req-3c7cf824-a5e2-4737-a18d-c1aa5a44aa06 service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:17.644580 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-8da5c026-8be5-46b7-9708-b581b181987c req-3c7cf824-a5e2-4737-a18d-c1aa5a44aa06 service nova] Creating event network-changed:923bbc6f-4f36-4f49-afad-b19ee3bebba7 for instance 2da52462-039d-49aa-87d9-937177392f44 on hv-cinder-83716 Apr 11 16:56:17.650456 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-8da5c026-8be5-46b7-9708-b581b181987c req-3c7cf824-a5e2-4737-a18d-c1aa5a44aa06 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057698 Apr 11 16:56:17.651731 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 586/1200] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:56:18.466675 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-9862607a-4d7d-4436-a4ac-7fc9cffcbb98 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:56:18.467238 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-9862607a-4d7d-4436-a4ac-7fc9cffcbb98 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] [instance: 2da52462-039d-49aa-87d9-937177392f44] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:56:18.474224 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9862607a-4d7d-4436-a4ac-7fc9cffcbb98 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:18.474673 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9862607a-4d7d-4436-a4ac-7fc9cffcbb98 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:18.475438 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9862607a-4d7d-4436-a4ac-7fc9cffcbb98 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:18.476041 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-9862607a-4d7d-4436-a4ac-7fc9cffcbb98 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:18.620595 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-9862607a-4d7d-4436-a4ac-7fc9cffcbb98 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023bd176fc74b82b9899734d604760c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac121a20bdfd4551be0c313096ce78a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:56:18.630576 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-9862607a-4d7d-4436-a4ac-7fc9cffcbb98 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] 10.222.0.65 "GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44" status: 200 len: 1314 microversion: 2.1 time: 0.167502 Apr 11 16:56:18.631856 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 615/1201] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:56:18 2022] GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:56:19.654887 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-ccc4e988-998e-4b1d-8532-eb5d032737ae tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:56:19.655568 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-ccc4e988-998e-4b1d-8532-eb5d032737ae tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] [instance: 2da52462-039d-49aa-87d9-937177392f44] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:56:19.662452 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ccc4e988-998e-4b1d-8532-eb5d032737ae tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:19.662845 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ccc4e988-998e-4b1d-8532-eb5d032737ae tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:19.663627 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ccc4e988-998e-4b1d-8532-eb5d032737ae tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:19.664081 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-ccc4e988-998e-4b1d-8532-eb5d032737ae tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:19.814906 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-ccc4e988-998e-4b1d-8532-eb5d032737ae tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023bd176fc74b82b9899734d604760c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac121a20bdfd4551be0c313096ce78a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:56:19.823332 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-ccc4e988-998e-4b1d-8532-eb5d032737ae tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] 10.222.0.65 "GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44" status: 200 len: 1314 microversion: 2.1 time: 0.173393 Apr 11 16:56:19.823969 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 587/1202] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:56:19 2022] GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:56:20.840526 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-22d2b8f2-1e8b-43f1-9b73-609e95a7ce7a tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:56:20.841114 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-22d2b8f2-1e8b-43f1-9b73-609e95a7ce7a tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] [instance: 2da52462-039d-49aa-87d9-937177392f44] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:56:20.847960 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-22d2b8f2-1e8b-43f1-9b73-609e95a7ce7a tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:20.848426 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-22d2b8f2-1e8b-43f1-9b73-609e95a7ce7a tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:20.849184 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-22d2b8f2-1e8b-43f1-9b73-609e95a7ce7a tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:20.849634 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-22d2b8f2-1e8b-43f1-9b73-609e95a7ce7a tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:20.990372 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-22d2b8f2-1e8b-43f1-9b73-609e95a7ce7a tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023bd176fc74b82b9899734d604760c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac121a20bdfd4551be0c313096ce78a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:56:21.000896 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-22d2b8f2-1e8b-43f1-9b73-609e95a7ce7a tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] 10.222.0.65 "GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44" status: 200 len: 1314 microversion: 2.1 time: 0.164041 Apr 11 16:56:21.001495 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 616/1203] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:56:20 2022] GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:56:22.018565 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-34024aa8-52ad-4ab5-9713-e99430b84bf8 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:56:22.019220 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-34024aa8-52ad-4ab5-9713-e99430b84bf8 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] [instance: 2da52462-039d-49aa-87d9-937177392f44] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:56:22.026719 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-34024aa8-52ad-4ab5-9713-e99430b84bf8 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:22.027160 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-34024aa8-52ad-4ab5-9713-e99430b84bf8 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:22.027935 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-34024aa8-52ad-4ab5-9713-e99430b84bf8 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:22.028369 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-34024aa8-52ad-4ab5-9713-e99430b84bf8 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:22.167454 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-34024aa8-52ad-4ab5-9713-e99430b84bf8 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023bd176fc74b82b9899734d604760c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac121a20bdfd4551be0c313096ce78a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:56:22.175296 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-34024aa8-52ad-4ab5-9713-e99430b84bf8 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] 10.222.0.65 "GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44" status: 200 len: 1314 microversion: 2.1 time: 0.160622 Apr 11 16:56:22.175926 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 588/1204] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:56:22 2022] GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:56:23.192815 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-ee0f66ee-30ec-47b5-b7b0-b73b94f82f86 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:56:23.193442 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-ee0f66ee-30ec-47b5-b7b0-b73b94f82f86 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] [instance: 2da52462-039d-49aa-87d9-937177392f44] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:56:23.200424 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ee0f66ee-30ec-47b5-b7b0-b73b94f82f86 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:23.200868 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ee0f66ee-30ec-47b5-b7b0-b73b94f82f86 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:23.201650 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ee0f66ee-30ec-47b5-b7b0-b73b94f82f86 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:23.202077 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-ee0f66ee-30ec-47b5-b7b0-b73b94f82f86 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:23.341058 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-ee0f66ee-30ec-47b5-b7b0-b73b94f82f86 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023bd176fc74b82b9899734d604760c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac121a20bdfd4551be0c313096ce78a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:56:23.350632 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-ee0f66ee-30ec-47b5-b7b0-b73b94f82f86 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] 10.222.0.65 "GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44" status: 200 len: 1314 microversion: 2.1 time: 0.161663 Apr 11 16:56:23.351232 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 617/1205] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:56:23 2022] GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:56:24.370486 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-004df0ff-3723-4767-937c-5cb5c6624264 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:56:24.371051 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-004df0ff-3723-4767-937c-5cb5c6624264 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] [instance: 2da52462-039d-49aa-87d9-937177392f44] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:56:24.377635 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-004df0ff-3723-4767-937c-5cb5c6624264 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:24.378080 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-004df0ff-3723-4767-937c-5cb5c6624264 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:24.378837 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-004df0ff-3723-4767-937c-5cb5c6624264 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:24.379262 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-004df0ff-3723-4767-937c-5cb5c6624264 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:24.521871 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-004df0ff-3723-4767-937c-5cb5c6624264 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023bd176fc74b82b9899734d604760c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac121a20bdfd4551be0c313096ce78a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:56:24.529426 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-004df0ff-3723-4767-937c-5cb5c6624264 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] 10.222.0.65 "GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44" status: 200 len: 1314 microversion: 2.1 time: 0.163547 Apr 11 16:56:24.530007 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 589/1206] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:56:24 2022] GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:56:25.107337 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [req-d7a65a3b-a391-4cef-8398-45d078cc9ac0 req-fc1a3563-138b-44b2-9047-d2bc9c455d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2da52462-039d-49aa-87d9-937177392f44", "name": "network-vif-plugged", "status": "completed", "tag": "923bbc6f-4f36-4f49-afad-b19ee3bebba7"}]} {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:56:25.116547 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-d7a65a3b-a391-4cef-8398-45d078cc9ac0 req-fc1a3563-138b-44b2-9047-d2bc9c455d2f service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:25.116983 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [req-d7a65a3b-a391-4cef-8398-45d078cc9ac0 req-fc1a3563-138b-44b2-9047-d2bc9c455d2f service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:25.131291 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.compute.server_external_events [req-d7a65a3b-a391-4cef-8398-45d078cc9ac0 req-fc1a3563-138b-44b2-9047-d2bc9c455d2f service nova] Creating event network-vif-plugged:923bbc6f-4f36-4f49-afad-b19ee3bebba7 for instance 2da52462-039d-49aa-87d9-937177392f44 on hv-cinder-83716 Apr 11 16:56:25.136680 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [req-d7a65a3b-a391-4cef-8398-45d078cc9ac0 req-fc1a3563-138b-44b2-9047-d2bc9c455d2f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035589 Apr 11 16:56:25.137608 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 618/1207] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:56:25.547233 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-5cae40cf-9a89-4787-86af-467d6dd0d8e0 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:56:25.547938 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-5cae40cf-9a89-4787-86af-467d6dd0d8e0 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] [instance: 2da52462-039d-49aa-87d9-937177392f44] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:56:25.554924 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5cae40cf-9a89-4787-86af-467d6dd0d8e0 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:25.555391 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5cae40cf-9a89-4787-86af-467d6dd0d8e0 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:25.556223 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5cae40cf-9a89-4787-86af-467d6dd0d8e0 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:25.556657 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-5cae40cf-9a89-4787-86af-467d6dd0d8e0 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:25.692835 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-5cae40cf-9a89-4787-86af-467d6dd0d8e0 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023bd176fc74b82b9899734d604760c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac121a20bdfd4551be0c313096ce78a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:56:25.700926 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-5cae40cf-9a89-4787-86af-467d6dd0d8e0 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] 10.222.0.65 "GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44" status: 200 len: 1314 microversion: 2.1 time: 0.157732 Apr 11 16:56:25.701504 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 590/1208] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:56:25 2022] GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:56:26.719460 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-20c03d87-034a-43db-baf8-32f1af33686b tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:56:26.720345 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-20c03d87-034a-43db-baf8-32f1af33686b tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] [instance: 2da52462-039d-49aa-87d9-937177392f44] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:56:26.727348 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-20c03d87-034a-43db-baf8-32f1af33686b tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:26.727967 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-20c03d87-034a-43db-baf8-32f1af33686b tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:26.728803 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-20c03d87-034a-43db-baf8-32f1af33686b tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:26.729300 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-20c03d87-034a-43db-baf8-32f1af33686b tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:26.867456 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-20c03d87-034a-43db-baf8-32f1af33686b tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023bd176fc74b82b9899734d604760c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac121a20bdfd4551be0c313096ce78a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:56:26.875158 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-20c03d87-034a-43db-baf8-32f1af33686b tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] 10.222.0.65 "GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44" status: 200 len: 1314 microversion: 2.1 time: 0.160488 Apr 11 16:56:26.875732 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 619/1209] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:56:26 2022] GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:56:27.892853 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-7d598d1a-76ba-49ab-bf2d-1c52cf86f706 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:56:27.893478 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-7d598d1a-76ba-49ab-bf2d-1c52cf86f706 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] [instance: 2da52462-039d-49aa-87d9-937177392f44] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:56:27.900280 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7d598d1a-76ba-49ab-bf2d-1c52cf86f706 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:27.900719 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7d598d1a-76ba-49ab-bf2d-1c52cf86f706 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:27.901483 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7d598d1a-76ba-49ab-bf2d-1c52cf86f706 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:27.901918 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7d598d1a-76ba-49ab-bf2d-1c52cf86f706 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:28.048652 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-7d598d1a-76ba-49ab-bf2d-1c52cf86f706 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023bd176fc74b82b9899734d604760c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac121a20bdfd4551be0c313096ce78a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:56:28.056755 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-7d598d1a-76ba-49ab-bf2d-1c52cf86f706 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] 10.222.0.65 "GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44" status: 200 len: 1464 microversion: 2.1 time: 0.167836 Apr 11 16:56:28.057345 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 591/1210] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:56:27 2022] GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44 => generated 1464 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:56:28.097774 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-3ef7f9c3-e763-431c-b61c-7751ec496ae0 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:56:28.098601 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3ef7f9c3-e763-431c-b61c-7751ec496ae0 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] [instance: 2da52462-039d-49aa-87d9-937177392f44] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:56:28.107892 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3ef7f9c3-e763-431c-b61c-7751ec496ae0 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:28.108402 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3ef7f9c3-e763-431c-b61c-7751ec496ae0 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:28.109440 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3ef7f9c3-e763-431c-b61c-7751ec496ae0 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:28.110008 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-3ef7f9c3-e763-431c-b61c-7751ec496ae0 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:28.137707 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-3ef7f9c3-e763-431c-b61c-7751ec496ae0 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] [instance: 2da52462-039d-49aa-87d9-937177392f44] Going to try to terminate instance {{(pid=123773) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 11 16:56:28.224290 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-3ef7f9c3-e763-431c-b61c-7751ec496ae0 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44" status: 204 len: 0 microversion: 2.1 time: 0.130381 Apr 11 16:56:28.225450 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 620/1211] 10.222.0.65 () {58 vars in 1238 bytes} [Mon Apr 11 16:56:28 2022] DELETE /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 16:56:28.234116 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-33742701-4a7a-478f-965a-c9f0a09b3bb1 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:56:28.234728 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-33742701-4a7a-478f-965a-c9f0a09b3bb1 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] [instance: 2da52462-039d-49aa-87d9-937177392f44] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:56:28.241280 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-33742701-4a7a-478f-965a-c9f0a09b3bb1 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:28.241656 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-33742701-4a7a-478f-965a-c9f0a09b3bb1 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:28.242420 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-33742701-4a7a-478f-965a-c9f0a09b3bb1 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:28.242846 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-33742701-4a7a-478f-965a-c9f0a09b3bb1 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:28.385847 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.policy [None req-33742701-4a7a-478f-965a-c9f0a09b3bb1 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023bd176fc74b82b9899734d604760c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac121a20bdfd4551be0c313096ce78a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123774) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:56:28.394068 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-33742701-4a7a-478f-965a-c9f0a09b3bb1 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] 10.222.0.65 "GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44" status: 200 len: 1470 microversion: 2.1 time: 0.163828 Apr 11 16:56:28.394695 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 592/1212] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:56:28 2022] GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:56:29.416978 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-2043172b-aae5-4df4-b4b1-8422ca1eeb74 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:56:29.417856 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-2043172b-aae5-4df4-b4b1-8422ca1eeb74 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] [instance: 2da52462-039d-49aa-87d9-937177392f44] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:56:29.425303 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2043172b-aae5-4df4-b4b1-8422ca1eeb74 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:29.425755 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2043172b-aae5-4df4-b4b1-8422ca1eeb74 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:29.426536 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2043172b-aae5-4df4-b4b1-8422ca1eeb74 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:29.426960 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-2043172b-aae5-4df4-b4b1-8422ca1eeb74 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:29.575330 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-2043172b-aae5-4df4-b4b1-8422ca1eeb74 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023bd176fc74b82b9899734d604760c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac121a20bdfd4551be0c313096ce78a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:56:29.584671 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-2043172b-aae5-4df4-b4b1-8422ca1eeb74 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] 10.222.0.65 "GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44" status: 200 len: 1470 microversion: 2.1 time: 0.171998 Apr 11 16:56:29.585249 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 621/1213] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:56:29 2022] GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44 => generated 1470 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:56:30.494189 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [req-0ccb3753-9284-47c0-ad8a-8f115ae9d1b2 req-c55ca952-76e7-4473-b0ce-6c19feabc69f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2da52462-039d-49aa-87d9-937177392f44", "name": "network-vif-deleted", "tag": "923bbc6f-4f36-4f49-afad-b19ee3bebba7"}]} {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:56:30.507680 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-0ccb3753-9284-47c0-ad8a-8f115ae9d1b2 req-c55ca952-76e7-4473-b0ce-6c19feabc69f service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:30.508573 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [req-0ccb3753-9284-47c0-ad8a-8f115ae9d1b2 req-c55ca952-76e7-4473-b0ce-6c19feabc69f service nova] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:30.522250 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.compute.server_external_events [req-0ccb3753-9284-47c0-ad8a-8f115ae9d1b2 req-c55ca952-76e7-4473-b0ce-6c19feabc69f service nova] Creating event network-vif-deleted:923bbc6f-4f36-4f49-afad-b19ee3bebba7 for instance 2da52462-039d-49aa-87d9-937177392f44 on hv-cinder-83716 Apr 11 16:56:30.528193 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [req-0ccb3753-9284-47c0-ad8a-8f115ae9d1b2 req-c55ca952-76e7-4473-b0ce-6c19feabc69f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037438 Apr 11 16:56:30.529645 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 593/1214] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Apr 11 16:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:56:30.603489 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.api.openstack.wsgi [None req-c37e002a-6a8b-4bd6-ba8a-ba5da546386d tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Calling method '>' {{(pid=123773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:56:30.604992 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.compute.api [None req-c37e002a-6a8b-4bd6-ba8a-ba5da546386d tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] [instance: 2da52462-039d-49aa-87d9-937177392f44] Fetching instance by UUID {{(pid=123773) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:56:30.612307 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c37e002a-6a8b-4bd6-ba8a-ba5da546386d tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:30.612749 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c37e002a-6a8b-4bd6-ba8a-ba5da546386d tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:30.613638 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c37e002a-6a8b-4bd6-ba8a-ba5da546386d tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:30.614557 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c37e002a-6a8b-4bd6-ba8a-ba5da546386d tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:30.647161 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c37e002a-6a8b-4bd6-ba8a-ba5da546386d tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:30.647503 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG oslo_concurrency.lockutils [None req-c37e002a-6a8b-4bd6-ba8a-ba5da546386d tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:30.647969 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.objects.instance [None req-c37e002a-6a8b-4bd6-ba8a-ba5da546386d tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lazy-loading 'fault' on Instance uuid 2da52462-039d-49aa-87d9-937177392f44 {{(pid=123773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 11 16:56:30.690505 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: DEBUG nova.policy [None req-c37e002a-6a8b-4bd6-ba8a-ba5da546386d tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023bd176fc74b82b9899734d604760c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac121a20bdfd4551be0c313096ce78a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123773) authorize /opt/stack/nova/nova/policy.py:199}} Apr 11 16:56:30.698579 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO nova.api.openstack.requestlog [None req-c37e002a-6a8b-4bd6-ba8a-ba5da546386d tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] 10.222.0.65 "GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44" status: 200 len: 1304 microversion: 2.1 time: 0.099772 Apr 11 16:56:30.699063 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: [pid: 123773|app: 0|req: 622/1215] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:56:30 2022] GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:56:31.718400 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-7c949ee4-b514-470a-b67e-4b98b470fd36 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Calling method '>' {{(pid=123774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:56:31.719742 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.compute.api [None req-7c949ee4-b514-470a-b67e-4b98b470fd36 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] [instance: 2da52462-039d-49aa-87d9-937177392f44] Fetching instance by UUID {{(pid=123774) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 11 16:56:31.729181 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7c949ee4-b514-470a-b67e-4b98b470fd36 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:31.729627 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7c949ee4-b514-470a-b67e-4b98b470fd36 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:31.730435 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7c949ee4-b514-470a-b67e-4b98b470fd36 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 11 16:56:31.730865 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG oslo_concurrency.lockutils [None req-7c949ee4-b514-470a-b67e-4b98b470fd36 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Lock "a14129a4-d92e-4c5c-b5b2-11cea54345dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 11 16:56:31.752128 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.wsgi [None req-7c949ee4-b514-470a-b67e-4b98b470fd36 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] HTTP exception thrown: Instance 2da52462-039d-49aa-87d9-937177392f44 could not be found. Apr 11 16:56:31.752915 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: DEBUG nova.api.openstack.wsgi [None req-7c949ee4-b514-470a-b67e-4b98b470fd36 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] Returning 404 to user: Instance 2da52462-039d-49aa-87d9-937177392f44 could not be found. {{(pid=123774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 11 16:56:31.754737 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO nova.api.openstack.requestlog [None req-7c949ee4-b514-470a-b67e-4b98b470fd36 tempest-VolumesNegativeTest-524561334 tempest-VolumesNegativeTest-524561334-project] 10.222.0.65 "GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44" status: 404 len: 111 microversion: 2.1 time: 0.041511 Apr 11 16:56:31.755329 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: [pid: 123774|app: 0|req: 594/1216] 10.222.0.65 () {58 vars in 1235 bytes} [Mon Apr 11 16:56:31 2022] GET /compute/v2.1/servers/2da52462-039d-49aa-87d9-937177392f44 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 16:57:12.633295 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:57:12.634212 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: Mon Apr 11 16:57:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 16:58:35.754471 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:58:35.755321 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: Mon Apr 11 16:58:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 16:58:42.705217 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:58:42.706166 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: Mon Apr 11 16:58:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 16:58:51.376156 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:58:51.376733 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: Mon Apr 11 16:58:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 16:59:12.404587 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 16:59:12.405581 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: Mon Apr 11 16:59:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 17:00:32.643475 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 17:00:32.644345 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: Mon Apr 11 17:00:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 17:01:55.764701 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 17:01:55.765336 dv-cinder-837165-2-iscsi devstack@n-api.service[123773]: Mon Apr 11 17:01:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 11 17:02:02.717485 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 17:02:02.718287 dv-cinder-837165-2-iscsi devstack@n-api.service[123774]: Mon Apr 11 17:02:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!